E-Series Performance Analyzer (EPA) v4 beta
Introduction EPA 4 EPA Collector-specific Details related to storage requirements What's next
Introduction EPA 4 EPA Collector-specific Details related to storage requirements What's next
Introduction Walk-through And now… Conclusion Appendix A: demo Animated GIF (no playback control) Video demo with voice-over ...
Introduction What it is What it does IIS Setup Why this matters What about it? Conclusion
Introduction What's new in 2025 Next steps
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
This is a two-part post:
Introduction Show me Why? Thoughts Conclusion
Background Firemox What it does, and doesn't (Stopping) scope creep Known issues and limitations Conclusion Demo and source c...
This is more appropriate for a tweet, but anyway…
Who wants it and why? Perl for the win! Features Effort Appendix A: what works and how Appendix B: observations, problems, solutions Appendix ...
Background Why this is cool Catches File/object duality considerations Conclusion Demo
Introduction What's new in BeeGFS file-system events in BeeGFS v8 Dude, where's my gRPC server? Can BeeGFS watch server, erhm, client, ...
Introduction SMB and NFS data migration Shell scripts and utilities XCP Elaborate schemes Enterprise software Example...
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
I wrote about Windows Server 2025 here.
Introduction What is the OPEA project The stack Docker vs. Kubernetes Where's the storage? E-Series storage and solution stack ...
Introduction MCP Use cases? Get, set, and security Conclusion Additional reading
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
Introduction Reference architectures High-level design and best practices What's new in Cloudera Base Deployment topology Sizin...
Introduction Approach Steps One or more instances Prepare your box Clone Harvest repo or download pre-built container image ...
Introduction What's backwards compatible and what's not in InfluxDB 3 Evaluate with E-Series Performance Analyzer Other details Conclusion Appen...
Introduction The problem Solutions Notes on MinIO Notes on VersityGW Benchmarking and testing VersityGW on scale-out file systems vs ...
Requirement Workflow Storage considerations Tools
Introduction How Other SolidFire-related tips Conclusion
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
Introduction Kubefire Simplified version of Longhorny focused on Kubernetes Automated replication service for SolidFire replication in ...
This series of posts has several parts:
Introduction Situation Procedure Kubernetes Conclusion Appendix A - upsize remote and resize in Longhorny
Intro Other objectives What's new in SFC Rewrite Back-end database change Asynchronous execution Drop SolidFire Python SD...
Intro About QoS histograms on NetApp SolidFire Request Response What are these things? Bucket naming Should you use QoS histogram information?...
Telegraf for heavy lifting? PoC with PowerShell Conclusion Appendix A - Python version
Introduction
WTF is SFC? Why bother when no one is using it? Progress so far Conclusion
It took me a while
If you want to develop or automate E-Series but aren't always connected, you may want to work offline with Swagger API files.
SolidFire doesn't have an OpenAPI interface. See here.
Introduction Initiating and monitoring SolidFire backup-to-S3 jobs Initiation Status Progress Completion and result ...
You may have heard Grafana 11 is coming out soon.
WTF is EConfig? What's new How I use EConfig DDP BeeGFS Troubles Conclusion Appendix A - BeeGFS sizer
Intro Using Kubernetes to backup non-Kubernetes volumes Dealing with alien filesystems Workflow for backup of non-K8s volumes on SolidFire using Vel...
Introduction
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
This is the first of possibly several posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Here we go again…
Introduction SANtricity API methods related to scrubbing, scanning, fixing data issues Media scan in Web UI Relevant API methods Implementation ...
Introduction Create, discover, login Efficiency - zpools on SoliFire vs global SolidFire efficiencies Comparison with XFS and BTRFS ...
Introduction Create, discover, login Efficiency - zpools on SoliFire vs global SolidFire efficiencies Comparison with XFS and BTRFS ...
Introduction What is E-Series anyway Easy storage management Conclusion
Introduction What's new with ZFS deduplication ZFS and E-Series Benefits of using ZFS with E-Series Deduplication Compression ...
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
Introduction Longer answer Other notes Disk snapshots and security E-Series vs. internal RAID Hardened repository volumes on E-Series w...
Introduction SolidFire backup to S3 MinIO compression Results Conclusions
Introduction
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
Introduction Inferencing with SolidFire Examples Making use of iSCSI Share data with a parallel file system Share ...
Introduction Clone and analyze Example with Postgres writeBytes metric Cost issue Do we still need to clone those snapshots? How to minimize s...
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Introduction Environment Tests Results Other performance views Conclusion
Problem statement Considerations First iteration Second iteration Conclusion
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
Problem statement E-Series side Ubuntu side Hardware and software stack Setup workflow Tips and tricks SANtricity Host settings ...
Introduction Configure SNMP trap destination in SANtricity OS Get E-Series MIB files and OID SANtricity SNMP walk SANtricity SNMP traps and trap e...
Introduction WTF is CSI Snapshot Data Movement (CSI SDM) Why is that a Good Thing Get ready to use CSI SDM with NetApp Astra Triden...
I've written several posts about NetApp's BeeGFS CSI driver.
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
Introduction Backup to ONTAP S3 Network configuration Workflow Discussion Backup to ONTAP S3 DR to ONTAP S3 ...
Introduction
Introduction
So… I don't use Generative AI.
Introduction
Update (2024/06): I haven't tested this yet, but it seems after Velero AWS Plugin v1.9, ONTAP S3 users can no longer use Velero. One workaround for this is t...
Why "Elasticsearches"?
Now that Azure Linux is out, maybe some SolidFire users wonder if Azure Linux iSCSI can connect to SolidFire targets?
Table of Contents
Snapshot attributes in SolidFire Hashtable example Snapshot with attributes Using snapshot attributes Conclusion
AWS mountpoint-s3 Deploy Use cases for E-Series and SolidFire S3 bucket as backup mountpoint Sub-bucket allocation ...
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
Backup repository choices for Kasten with E-Series Veeam Repository S3 bucket NFS share Which one to use? Cost and performance Se...
Why overprovisioning exists Who needs this BeeGFS example Who doesn't need this Impact on capacity sizing Impact on deployment ...
EPA on Kubernetes and Nomad is here
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
SolidFire and eSDS (containerized SolidFire for 3rd party x86 servers) version 12.7 was released in late October, but I haven't blogged about it.
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
This week NetApp released BeeGFS CSI driver v1.4.0 which adds support for newer Kubernetes and BeeGFS.
E-Series Performance Analyzer (EPA) v3.0.0 collects MEL (Major Event Log) events and send them to InfluxDB. I think SANtricity syslog events have similar inf...
NetApp E-Series Prometheus Exporter
Configure SANtricity to send array events to a remote syslog server
CSI choices for E-Series in a Kubernetes environment What's out there in terms of DAS CSI for Kubernetes Unique DAS approaches How ...
Long story short, password rotation scripts should directly use the SANtricity (or Web Services Proxy, if you can't get directly to SANtricity) API and not t...
Introduction Compute layer and storage interconnect Small and large clusters HDDs, SSDs, RAID, DDP… How to automate E-Series volume provisioning t...
Introduction API Check TLS Traditional login JWTs Use SANtricity Bearer Token Demo References Conclusion
Rocky Linux 8 and 9 have been added to the NetApp E-Series interoperability matrix starting with SANtricity 11.70.
I've written about several ways we can take advantage of MinIO with NetApp E-Series back-ends, for example in the post on MinIO on HashiCorp Nomad with BeeGF...
BeeGFS can work with different storage targets, so just like with Spectrum Scale it is possible to create a filesystem that spans across different disk media...
Introduction Non-CSI with Restic and NetApp BeeGFS CSI CSI with NetApp Trident What's new in 1.9 and 1.8 Velero on ARM64 Restic (ARM64)...
Introduction Cloudflare scenarios for Hybrid Cloud users Experiment Conclusion
While reading the excellent article Why We Migrated from Kubernetes to Nomad (2021) it occurred to me I spotted some of the same advantages while working on ...
I had thought the posts I wrote about Trident on ARM64 were enough to get almost everyone going, but it seems it's not hard to get stuck.
Following my previous post on TensorStore with BeeGFS I thought I should revisit another item from my lengthy to-do list: filesystem compression.
TensorStore is a new C++ and Python library that provides a uniform API for reading and writing n-dimensional data.
This week NetApp released product communique CPC-00467 (NetApp support portal login required) on end of availability of SolidFire.
NOTE: the Web site with this tool was improved and updated on 2024/04/19, so some details below may differ from current functionality
Dynamic Disk Pools vs. Disk Groups New DDP configuration What does that mean? Things to note SANtricity Web Services Proxy Web Proxy Container ...
Introduction Considerations Create configuration options Choice of query tool Show available options Query capacity range Manual selection of ...
Normally SolidFire 11 and 12 use Management Network for volume backup. Some users prefer to have backup flow over Storage Network.
It may not be easy to digest how BeeGFS with NetApp E-Series is usually configured.
NOTE: Since BeeGFS v7.3.3 there's an improved and self-contained monitoring package. There's no need to use this approach on BeeGFS v7.3.3 and beyond. See th...
Nextflow configuration and environment variables allow us to make use of BeeGFS with E-Series for most demanding IO tasks.
I have a small Nomad cluster which can access a BeeGFS filesystem.
Apptainer is based on the Singularity project.
There's a PowerShell script sfvid2nid.ps1 in my Awesome SolidFire repository on Github. It produces a table that shows the mapping of volume IDs to node IDs.
Introduction XCP-NG with SolidFire XOA Conclusion
Introduction
WTF is Milvus Storage-related stuff Meta storage (etcd) Logs and queues Object store Storage efficiency High availabi...
I'm supposed to be resting this week and that hasn't been working out… Still, I'll try to keep this one shorter than the previous two posts from this week.
Objective How I tested Kafka tests and results Random ASCII records StorageGRID audit log Protecting Kafka on a single site...
Multi-tiered storage in Kafka clusters How to leverage E-Series Performance vs. data protection overhead Sequential performance vs. lat...
HDFS Durability and External Protected Storage Does everyone need RF2 HDFS Erasure Coding Compression NFS gateway Snapsho...
While the ability to move files (or blocks) from and to other filesystems is nice, it isn't always necessary or desirable.
Kubernetes-native RBAC S3 Object Lock support "Officialized" (Kanister) blueprints for SQL Server and PostgreSQL Operator aka PGO OpenStack and vSph...
Most cloud users know about the various options to rent cloud compute resources.
NetApp E-Series are fast-performing disk arrays frequently used by big data, analytics, video processing, NOSQL databases, and HPC applications. You can find...
SolidFire and eSDS (containerized SolidFire for 3rd party x86 servers) version 12.5 just came out.
How would we use SolidFire Backup to S3 with Object Lock-enabled buckets Practical observations How many S3 objects or accounts do we need ...
Why access Trident API Controller routes Trident resources Expose the Trident REST API Examples What about it Appendix: List of Trident Resour...
What is SFC Making SolidFire Collector work with Kubernetes Appendix: Deploymennt for SFC and Graphite
BeeGFS 7.3.0 for ARM64 Attempt 1 Attempt 2 Video walk-through
One of more obvious characteristics of Persistent Volumes is they persist, i.e. survive pod(s) that use them until the claim for the PV itself is deleted, as...
solidfire-operator is a Proof-of-Concept operator for Kubernetes built using Operator Framework.
Introduction Setup Scaling-out IO-intensive batch jobs Shared file system vs. file server vs. internal disk Scale-out batch jobs with Nomad I/O an...
Introduction What Kanister does Summary Demo
Introduction Use cases Getting started Options in a mixed environment Deploy and use BeeGFS CSI Data protection Summary Demo
Configure Proxmox 7.1 with SolidFire 12.3 SolidFire Demo VM on Proxmox
Introduction Setup Generic batch job with I/O to parallel filesystem File format conversion Summary Demo
Introduction How it works Rest Server E-Series Dealing with the risk of storage-side snapshot rotation Storage efficiency Thi...
Introduction
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Introduction NetApp E-Series NetApp BeeGFS CSI Other CSI provisioners and non-CSI approaches NetApp SolidFire Cind...
ONTAP has had S3 service for a while now. While ONTAP S3 isn't meant to take over large and complex S3 workloads in which NetApp StorageGRID excels, it is mo...
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
One annoyance with Active IQ connectivity from Hybrid Cloud Control for SolidFire/NetApp HCI/eSDS is that it's not easy to tell what's going on with it when ...
NOTICE: all credentials and tokens on this page are samples, not leaked.
Today I got this error on Kubernetes v1.23.4 while trying out a Trident CLI command (tridentctl):
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
This week I heard of a StorageGRID customer who had a query about data processing in the cloud. Probably instinctively, their first idea was to copy data to ...
It's very easy and works as you expected:
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
Just a few examples for those who struggle to get started.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
This is speculative and I haven't tried it, but it looks very interesting.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Digital Ocean is a no-nonsense cloud provider that you've probably heard of.
In the case you missed NetApp INSIGHT 2021 and want to catch up with latest SolidFire developments, I recommend to consider some of the following sessions.
Some two months ago I rewrote SGAC and released it as v0.1.
Create a bucket, say quay, and a set of S3 keys for one of your S3 users to use with this bucket.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
To answer the question quickly: logical backups make sense.
Say you have a bucket called junk with "directory tree" (not really but…) several levels deep (junk/lev1/lev2) and want to do some ILM stuff on the stuff in ...
Create two buckets, source and destination, a PUT a test object with some junk tags to source/.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
How it begun
Latest & greatest NetApp Trident is out!
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
In the post that compares SolidFire Protection Domains with Availability Zones I had this illustration of network connectivity among SolidFire v12 cluster no...
RAID 6 vs DDP DDP expansion Disk media refresh with DDP pools Demo
SolidFire can backup volumes to S3-compatible Object Storage. How to do it in parallel, I wrote about here.
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
Everyone should get the hard-to-find TR-4741 (NetApp Element Software Remote Replication), but to answer the simple question: "all of the above".
SolidFire Double Helix
If I had a SolidFire array in a VM and container environment (which I do), I'd prefer to run Prometheus and Grafana in VMs, rather than cram the monitoring i...
In the first solidfire-exporter post I went through the first two steps required to gather SolidFire (or NetApp HCI) data and get it into Prometheus. I also ...
Maintenance Mode is a relatively new SolidFire feature that takes a node in and out of the neutral. In other words, it nicely moves a node's services to rema...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
What Upgrade procedure Before Out with the old, in with the new Verify success Trident for ARM64 and other non-AMD64 ar...
In the previous post I explained how SolidFire's built-in backup/restore to/from S3 works and how we can automate it. This post is about doing less automatio...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Snapshot queue and serialization
While experimenting with SolidFire and Trident CSI failover for Kubernetes, I came across a challenge:
Introduction What does it do Storing and protecting your IoT data Object Stores for Photon IoT C2C (Cloud to Container) How to process IoT data up...
NetApp HCI compute nodes are normally monitored from mNode, which is a VM that fetches events from both storage and compute nodes.
UPDATE Summary Introduction Comparison between PV Patching and Trident Volume Import approach Why only Scena...
WTF is EON Mode What do I need to do to get Vertica EON Mode work with StorageGRID TLS certificate for HTTPS IP address for S3 API endp...
Intro Build \& Deploy What about s390x, ppc64le and other architectures Next steps Version info Notes on linux/s390x (Feb 25, 2021)
Docker Registry
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NetApp Cloud Backup Service backs up your ONTAP data to your Object Storage bucket located in the cloud (Amazon, Azure, Google Cloud).
"There's no documentation" is different from "there are no copy-paste examples".
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
Summary Test results Configuration Elasticsearch data protection with EF-Series Workload description Performan...
Things are getting interesting Does EF-Series for Splunk on NetApp HCI make sense How does it work How does that compare with other HCI C...
Summary Why and when run BeeGFS in NetApp HCI VMs Aren't shared file systems complex to deploy and manage How do automation and virtualization help ...
Summary Why test EF280 performance from a VM VMFS vs. Raw Devices Manageability and iSCSI Cost of an All Flash backup tier ...
This comes up every so often:
Rancher and other Kubernetes users want to protect their applications and data. NetApp HCI and its underlying SolidFire storage are used by NetApp Trident to...
This is a nice Christmas present as far as I am concerned, because it's been a while since SolidFire PowerShell tools, sfcli and their respective SDKs v1.5 h...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Hybrid Cloud Control (HCC) is a group of services - management plane, if you will - for out-of-band management of NetApp HCI, SolidFire and eSDS. Currently i...
If you search for "iSCSI vs FC performance" it's not easy to find a recent like-for-like comparison from enterprise vendors. I've been puzzled by this and I ...
Say we have a Volume ID 321 with a storage QoS Policy ID 5, and need to run a temporary job that would benefit from a different Storage QoS Policy (higher or...
SolidFire Management Node (aka mNode) is a VM that runs Hybrid Cloud Services (various "management stuff".) Let's say we wanted to collect and analyze those ...
The Provider is now available from the official Terraform registry. This means we no longer need to download and build it manually. It is also easy to use it...
NetApp HCI, SolidFire, eSDS Web UI
Earlier this week I spotted the advice to not select a VM host when deploying Rancher worker VMs to a vSphere environment where DRS is enabled, because "DRS ...
solid-rancher is a Github repo I created to organize and enrich information related to Rancher on SolidFire (and NetApp HCI in general).
Introduction Walk-through And now… Conclusion Appendix A: demo Animated GIF (no playback control) Video demo with voice-over ...
Introduction What it is What it does IIS Setup Why this matters What about it? Conclusion
Introduction What's new in 2025 Next steps
Introduction Show me Why? Thoughts Conclusion
Background Firemox What it does, and doesn't (Stopping) scope creep Known issues and limitations Conclusion Demo and source c...
This is more appropriate for a tweet, but anyway…
Who wants it and why? Perl for the win! Features Effort Appendix A: what works and how Appendix B: observations, problems, solutions Appendix ...
Introduction SFC 2.1 Queries Summary
I wrote about Windows Server 2025 here.
Introduction MCP Use cases? Get, set, and security Conclusion Additional reading
Introduction What's backwards compatible and what's not in InfluxDB 3 Evaluate with E-Series Performance Analyzer Other details Conclusion Appen...
Requirement Workflow Storage considerations Tools
Introduction How Other SolidFire-related tips Conclusion
Introduction Kubefire Simplified version of Longhorny focused on Kubernetes Automated replication service for SolidFire replication in ...
This series of posts has several parts:
Introduction Situation Procedure Kubernetes Conclusion Appendix A - upsize remote and resize in Longhorny
Introduction
Pull QoS policy from SolidFire into Trident back-end configuration for solidfire-san Exercise care What does the IOPS really do? What does all this ...
Introduction Slightly confusing SolidFire snapshot schedules Create a schedule Group vs. single One volume, multiple schedules FIFO settings ...
Intro Other objectives What's new in SFC Rewrite Back-end database change Asynchronous execution Drop SolidFire Python SD...
Intro About QoS histograms on NetApp SolidFire Request Response What are these things? Bucket naming Should you use QoS histogram information?...
Telegraf for heavy lifting? PoC with PowerShell Conclusion Appendix A - Python version
Introduction
WTF is SFC? Why bother when no one is using it? Progress so far Conclusion
It took me a while
SolidFire doesn't have an OpenAPI interface. See here.
Introduction Initiating and monitoring SolidFire backup-to-S3 jobs Initiation Status Progress Completion and result ...
You may have heard Grafana 11 is coming out soon.
Intro Using Kubernetes to backup non-Kubernetes volumes Dealing with alien filesystems Workflow for backup of non-K8s volumes on SolidFire using Vel...
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
This is the first of possibly several posts on Microsoft Windows Server 2025 and NetApp SolidFire.
What is Verda Example with Redis Conclusion
Introduction Backup detail enhancements in Velero v1.13 Mapping Velero jobs to SolidFire volume and snapshot objects How many Veler...
Here we go again…
Introduction Create, discover, login Efficiency - zpools on SoliFire vs global SolidFire efficiencies Comparison with XFS and BTRFS ...
Introduction Storage options exposed in Virtual Manager Filesystem directory Physical disk device Preformatted block device ...
Introduction Challenges with vSphere 8 on NetApp HCI Alternatives NetApp HCI storage and data migration Summary Appendix A - VirtualBox Append...
Introduction KEDA concepts and components Scalers KEDA and persistent storage SolidFire E-Series Storage-related events ...
Introduction General notes on NTFS rehinning and SolidFire QoS-related tips Prepare Windows host volume SDelete SDelete with Windows gu...
Introduction SolidFire backup to S3 MinIO compression Results Conclusions
Introduction Fixing RBAC with a TLS-terminating reverse proxy Lua in reverse proxy path JSON-RPC Lua and JSON-RPC Complicate things...
Introduction Inferencing with SolidFire Examples Making use of iSCSI Share data with a parallel file system Share ...
Introduction Clone and analyze Example with Postgres writeBytes metric Cost issue Do we still need to clone those snapshots? How to minimize s...
Introduction WTF is CSI Snapshot Data Movement (CSI SDM) Why is that a Good Thing Get ready to use CSI SDM with NetApp Astra Triden...
Objectives and tools Steps to set up backup with Kopia Steps on OS and SolidBackup Steps related to Kopia Ensuring SolidBackup an...
What is Simple Backups? Use Simple Backups for File-type backup with SolidFire clones mounted to a "backup VM" Backup sizes compared to Solid...
Why Automation Generate data and backup volumes Restore S3 backups to new SolidFire volumes Restore-related notes Cost estimati...
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
Introduction Digression Purpose Volume mode in PVC How does this help us with git clone problem Conclusion...
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
Introduction Backup to ONTAP S3 Network configuration Workflow Discussion Backup to ONTAP S3 DR to ONTAP S3 ...
Introduction
Introduction
Now that Azure Linux is out, maybe some SolidFire users wonder if Azure Linux iSCSI can connect to SolidFire targets?
Table of Contents
Snapshot attributes in SolidFire Hashtable example Snapshot with attributes Using snapshot attributes Conclusion
SolidFire and eSDS (containerized SolidFire for 3rd party x86 servers) version 12.7 was released in late October, but I haven't blogged about it.
Introduction Cloudflare scenarios for Hybrid Cloud users Experiment Conclusion
This week NetApp released product communique CPC-00467 (NetApp support portal login required) on end of availability of SolidFire.
Normally SolidFire 11 and 12 use Management Network for volume backup. Some users prefer to have backup flow over Storage Network.
The official Trident documentation is okay, but it mentions no Rocky Linux.
There's a PowerShell script sfvid2nid.ps1 in my Awesome SolidFire repository on Github. It produces a table that shows the mapping of volume IDs to node IDs.
Introduction XCP-NG with SolidFire XOA Conclusion
Introduction
Objective How I tested Kafka tests and results Random ASCII records StorageGRID audit log Protecting Kafka on a single site...
Kubernetes-native RBAC S3 Object Lock support "Officialized" (Kanister) blueprints for SQL Server and PostgreSQL Operator aka PGO OpenStack and vSph...
SolidFire and eSDS (containerized SolidFire for 3rd party x86 servers) version 12.5 just came out.
How would we use SolidFire Backup to S3 with Object Lock-enabled buckets Practical observations How many S3 objects or accounts do we need ...
What is SFC Making SolidFire Collector work with Kubernetes Appendix: Deploymennt for SFC and Graphite
One of more obvious characteristics of Persistent Volumes is they persist, i.e. survive pod(s) that use them until the claim for the PV itself is deleted, as...
solidfire-operator is a Proof-of-Concept operator for Kubernetes built using Operator Framework.
Configure Proxmox 7.1 with SolidFire 12.3 SolidFire Demo VM on Proxmox
Introduction
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Introduction Deploy Nomad with SolidFire Host Volumes Backup and restore Backup data from VM with SolidFire-based as Host Volumes Bac...
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
One annoyance with Active IQ connectivity from Hybrid Cloud Control for SolidFire/NetApp HCI/eSDS is that it's not easy to tell what's going on with it when ...
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
It's very easy and works as you expected:
Just a few examples for those who struggle to get started.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
This is speculative and I haven't tried it, but it looks very interesting.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Digital Ocean is a no-nonsense cloud provider that you've probably heard of.
In the case you missed NetApp INSIGHT 2021 and want to catch up with latest SolidFire developments, I recommend to consider some of the following sessions.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
To answer the question quickly: logical backups make sense.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
In the post that compares SolidFire Protection Domains with Availability Zones I had this illustration of network connectivity among SolidFire v12 cluster no...
SolidFire can backup volumes to S3-compatible Object Storage. How to do it in parallel, I wrote about here.
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
Everyone should get the hard-to-find TR-4741 (NetApp Element Software Remote Replication), but to answer the simple question: "all of the above".
SolidFire Double Helix
If I had a SolidFire array in a VM and container environment (which I do), I'd prefer to run Prometheus and Grafana in VMs, rather than cram the monitoring i...
In the first solidfire-exporter post I went through the first two steps required to gather SolidFire (or NetApp HCI) data and get it into Prometheus. I also ...
Maintenance Mode is a relatively new SolidFire feature that takes a node in and out of the neutral. In other words, it nicely moves a node's services to rema...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
In the previous post I explained how SolidFire's built-in backup/restore to/from S3 works and how we can automate it. This post is about doing less automatio...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Snapshot queue and serialization
While experimenting with SolidFire and Trident CSI failover for Kubernetes, I came across a challenge:
NetApp HCI compute nodes are normally monitored from mNode, which is a VM that fetches events from both storage and compute nodes.
UPDATE Summary Introduction Comparison between PV Patching and Trident Volume Import approach Why only Scena...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
What's new in HCICollector v0.7 Improvements Setbacks What's next for HCICollector Unsolvable NetApp Trident Download HCI...
Intro Build \& Deploy What about s390x, ppc64le and other architectures Next steps Version info Notes on linux/s390x (Feb 25, 2021)
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Things are getting interesting Does EF-Series for Splunk on NetApp HCI make sense How does it work How does that compare with other HCI C...
Summary Why and when run BeeGFS in NetApp HCI VMs Aren't shared file systems complex to deploy and manage How do automation and virtualization help ...
Summary Why test EF280 performance from a VM VMFS vs. Raw Devices Manageability and iSCSI Cost of an All Flash backup tier ...
This comes up every so often:
Rancher and other Kubernetes users want to protect their applications and data. NetApp HCI and its underlying SolidFire storage are used by NetApp Trident to...
This is a nice Christmas present as far as I am concerned, because it's been a while since SolidFire PowerShell tools, sfcli and their respective SDKs v1.5 h...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Hybrid Cloud Control (HCC) is a group of services - management plane, if you will - for out-of-band management of NetApp HCI, SolidFire and eSDS. Currently i...
Say we have a Volume ID 321 with a storage QoS Policy ID 5, and need to run a temporary job that would benefit from a different Storage QoS Policy (higher or...
SolidFire Management Node (aka mNode) is a VM that runs Hybrid Cloud Services (various "management stuff".) Let's say we wanted to collect and analyze those ...
The Provider is now available from the official Terraform registry. This means we no longer need to download and build it manually. It is also easy to use it...
Introduction Update 1 (2023/08/30) Update 2 (2025/05/03) Update 3 (2025/06/07) FAQs
NetApp HCI, SolidFire, eSDS Web UI
Earlier this week I spotted the advice to not select a VM host when deploying Rancher worker VMs to a vSphere environment where DRS is enabled, because "DRS ...
solid-rancher is a Github repo I created to organize and enrich information related to Rancher on SolidFire (and NetApp HCI in general).
Background Why this is cool Catches File/object duality considerations Conclusion Demo
Introduction What's new in BeeGFS file-system events in BeeGFS v8 Dude, where's my gRPC server? Can BeeGFS watch server, erhm, client, ...
Introduction Reference architectures High-level design and best practices What's new in Cloudera Base Deployment topology Sizin...
Introduction What's backwards compatible and what's not in InfluxDB 3 Evaluate with E-Series Performance Analyzer Other details Conclusion Appen...
Introduction The problem Solutions Notes on MinIO Notes on VersityGW Benchmarking and testing VersityGW on scale-out file systems vs ...
What is a volume created by Volume Copy operation How does it work? Progress Reserve size Reserve location Priority Automating Volume Copy A...
WTF is EConfig? What's new How I use EConfig DDP BeeGFS Troubles Conclusion Appendix A - BeeGFS sizer
Introduction Reinventing the wheel Components Workflow Expected outcome Next steps Security Quotas and ACLs Monitoring ...
WTH is "SSD Cache" Create SSD cache Configure HDD-based volumes to use SSD Cache Summary API for monitoring
Get NetApp.SANtricity module for PowerShell 5.1 Install and load Use End Appendix A - Known issues \& workarounds
Introduction What is E-Series anyway Easy storage management Conclusion
Introduction What's new with ZFS deduplication ZFS and E-Series Benefits of using ZFS with E-Series Deduplication Compression ...
Introduction Longer answer Other notes Disk snapshots and security E-Series vs. internal RAID Hardened repository volumes on E-Series w...
Introduction KEDA concepts and components Scalers KEDA and persistent storage SolidFire E-Series Storage-related events ...
Introduction Torch checkpoints Filesystem format, path and files Example Storage considerations File system considerations S3 vs cluster file ...
Introduction
Introduction Existing material Related posts on this blog Observations TB per day Events per day Sizing challenges ...
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Introduction Environment Tests Results Other performance views Conclusion
Problem statement Considerations First iteration Second iteration Conclusion
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Introduction Software stack Getting E-Series events and metrics into PRTG Generic probes SNMP walk SNMP traps Custom sens...
Problem statement E-Series side Ubuntu side Hardware and software stack Setup workflow Tips and tricks SANtricity Host settings ...
What Config How Using Conclusion Appendix - External performance test
Introduction Configure SNMP trap destination in SANtricity OS Get E-Series MIB files and OID SANtricity SNMP walk SANtricity SNMP traps and trap e...
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
What
AWS mountpoint-s3 Deploy Use cases for E-Series and SolidFire S3 bucket as backup mountpoint Sub-bucket allocation ...
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
EPA v3.3.0 will be the next release of EPA and I'm aiming for two small improvements:
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
Backup repository choices for Kasten with E-Series Veeam Repository S3 bucket NFS share Which one to use? Cost and performance Se...
Why overprovisioning exists Who needs this BeeGFS example Who doesn't need this Impact on capacity sizing Impact on deployment ...
EPA on Kubernetes and Nomad is here
Problem statement Data replication Storage CSI drivers GPU compute nodes Performance monitoring Workflow
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
This week NetApp released BeeGFS CSI driver v1.4.0 which adds support for newer Kubernetes and BeeGFS.
E-Series Performance Analyzer (EPA) v3.0.0 collects MEL (Major Event Log) events and send them to InfluxDB. I think SANtricity syslog events have similar inf...
NetApp E-Series Prometheus Exporter
Configure SANtricity to send array events to a remote syslog server
CSI choices for E-Series in a Kubernetes environment What's out there in terms of DAS CSI for Kubernetes Unique DAS approaches How ...
Long story short, password rotation scripts should directly use the SANtricity (or Web Services Proxy, if you can't get directly to SANtricity) API and not t...
Should we use E-Series Performance Analyzer or SANtricity Web UI to monitor E-Series performance Various E-Series Performance Analyzer (EPA) notes ...
Rocky Linux 8 and 9 have been added to the NetApp E-Series interoperability matrix starting with SANtricity 11.70.
I've written about several ways we can take advantage of MinIO with NetApp E-Series back-ends, for example in the post on MinIO on HashiCorp Nomad with BeeGF...
BeeGFS can work with different storage targets, so just like with Spectrum Scale it is possible to create a filesystem that spans across different disk media...
While reading the excellent article Why We Migrated from Kubernetes to Nomad (2021) it occurred to me I spotted some of the same advantages while working on ...
Following my previous post on TensorStore with BeeGFS I thought I should revisit another item from my lengthy to-do list: filesystem compression.
TensorStore is a new C++ and Python library that provides a uniform API for reading and writing n-dimensional data.
NOTE: the Web site with this tool was improved and updated on 2024/04/19, so some details below may differ from current functionality
Dynamic Disk Pools vs. Disk Groups New DDP configuration What does that mean? Things to note SANtricity Web Services Proxy Web Proxy Container ...
Introduction Considerations Create configuration options Choice of query tool Show available options Query capacity range Manual selection of ...
Introduction Why LXD on BeeGFS (with or without NetApp E-Series) Get started Optimal BeeGFS settings HA BeeGFS client in LXD VMs on LXD server a...
It may not be easy to digest how BeeGFS with NetApp E-Series is usually configured.
NOTE: Since BeeGFS v7.3.3 there's an improved and self-contained monitoring package. There's no need to use this approach on BeeGFS v7.3.3 and beyond. See th...
Nomad Pack and Nomad BeeGFS Nomad Pack for InfluxDB on Nomad with BeeGFS Backup \& restore Using influx backup Conclusion
Nextflow configuration and environment variables allow us to make use of BeeGFS with E-Series for most demanding IO tasks.
I have a small Nomad cluster which can access a BeeGFS filesystem.
I have a small Nomad cluster which can access a BeeGFS filesystem.
Apptainer is based on the Singularity project.
Introduction
I'm supposed to be resting this week and that hasn't been working out… Still, I'll try to keep this one shorter than the previous two posts from this week.
Multi-tiered storage in Kafka clusters How to leverage E-Series Performance vs. data protection overhead Sequential performance vs. lat...
HDFS Durability and External Protected Storage Does everyone need RF2 HDFS Erasure Coding Compression NFS gateway Snapsho...
While the ability to move files (or blocks) from and to other filesystems is nice, it isn't always necessary or desirable.
NetApp E-Series are fast-performing disk arrays frequently used by big data, analytics, video processing, NOSQL databases, and HPC applications. You can find...
BeeGFS 7.3.0 for ARM64 Attempt 1 Attempt 2 Video walk-through
Introduction Setup Scaling-out IO-intensive batch jobs Shared file system vs. file server vs. internal disk Scale-out batch jobs with Nomad I/O an...
Introduction What Kanister does Summary Demo
Introduction Use cases Getting started Options in a mixed environment Deploy and use BeeGFS CSI Data protection Summary Demo
Introduction Setup Generic batch job with I/O to parallel filesystem File format conversion Summary Demo
Introduction How it works Rest Server E-Series Dealing with the risk of storage-side snapshot rotation Storage efficiency Thi...
NOTICE: all credentials and tokens on this page are samples, not leaked.
RAID 6 vs DDP DDP expansion Disk media refresh with DDP pools Demo
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
Summary Test results Configuration Elasticsearch data protection with EF-Series Workload description Performan...
Things are getting interesting Does EF-Series for Splunk on NetApp HCI make sense How does it work How does that compare with other HCI C...
Summary Why and when run BeeGFS in NetApp HCI VMs Aren't shared file systems complex to deploy and manage How do automation and virtualization help ...
Summary Why test EF280 performance from a VM VMFS vs. Raw Devices Manageability and iSCSI Cost of an All Flash backup tier ...
If you search for "iSCSI vs FC performance" it's not easy to find a recent like-for-like comparison from enterprise vendors. I've been puzzled by this and I ...
Introduction EPA 4 EPA Collector-specific Details related to storage requirements What's next
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
Introduction What is the OPEA project The stack Docker vs. Kubernetes Where's the storage? E-Series storage and solution stack ...
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
If you want to develop or automate E-Series but aren't always connected, you may want to work offline with Swagger API files.
WTF is EConfig? What's new How I use EConfig DDP BeeGFS Troubles Conclusion Appendix A - BeeGFS sizer
Introduction Reinventing the wheel Components Workflow Expected outcome Next steps Security Quotas and ACLs Monitoring ...
WTH is "SSD Cache" Create SSD cache Configure HDD-based volumes to use SSD Cache Summary API for monitoring
Get NetApp.SANtricity module for PowerShell 5.1 Install and load Use End Appendix A - Known issues \& workarounds
Introduction SANtricity API methods related to scrubbing, scanning, fixing data issues Media scan in Web UI Relevant API methods Implementation ...
Introduction Longer answer Other notes Disk snapshots and security E-Series vs. internal RAID Hardened repository volumes on E-Series w...
Introduction KEDA concepts and components Scalers KEDA and persistent storage SolidFire E-Series Storage-related events ...
Introduction
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
Introduction Existing material Related posts on this blog Observations TB per day Events per day Sizing challenges ...
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Introduction Environment Tests Results Other performance views Conclusion
Problem statement Considerations First iteration Second iteration Conclusion
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Introduction Software stack Getting E-Series events and metrics into PRTG Generic probes SNMP walk SNMP traps Custom sens...
Problem statement E-Series side Ubuntu side Hardware and software stack Setup workflow Tips and tricks SANtricity Host settings ...
What Config How Using Conclusion Appendix - External performance test
Introduction Configure SNMP trap destination in SANtricity OS Get E-Series MIB files and OID SANtricity SNMP walk SANtricity SNMP traps and trap e...
I've written several posts about NetApp's BeeGFS CSI driver.
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
What
Why overprovisioning exists Who needs this BeeGFS example Who doesn't need this Impact on capacity sizing Impact on deployment ...
EPA on Kubernetes and Nomad is here
Problem statement Data replication Storage CSI drivers GPU compute nodes Performance monitoring Workflow
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
This week NetApp released BeeGFS CSI driver v1.4.0 which adds support for newer Kubernetes and BeeGFS.
E-Series Performance Analyzer (EPA) v3.0.0 collects MEL (Major Event Log) events and send them to InfluxDB. I think SANtricity syslog events have similar inf...
NetApp E-Series Prometheus Exporter
Configure SANtricity to send array events to a remote syslog server
CSI choices for E-Series in a Kubernetes environment What's out there in terms of DAS CSI for Kubernetes Unique DAS approaches How ...
Long story short, password rotation scripts should directly use the SANtricity (or Web Services Proxy, if you can't get directly to SANtricity) API and not t...
Should we use E-Series Performance Analyzer or SANtricity Web UI to monitor E-Series performance Various E-Series Performance Analyzer (EPA) notes ...
Rocky Linux 8 and 9 have been added to the NetApp E-Series interoperability matrix starting with SANtricity 11.70.
I've written about several ways we can take advantage of MinIO with NetApp E-Series back-ends, for example in the post on MinIO on HashiCorp Nomad with BeeGF...
BeeGFS can work with different storage targets, so just like with Spectrum Scale it is possible to create a filesystem that spans across different disk media...
While reading the excellent article Why We Migrated from Kubernetes to Nomad (2021) it occurred to me I spotted some of the same advantages while working on ...
Following my previous post on TensorStore with BeeGFS I thought I should revisit another item from my lengthy to-do list: filesystem compression.
TensorStore is a new C++ and Python library that provides a uniform API for reading and writing n-dimensional data.
NOTE: the Web site with this tool was improved and updated on 2024/04/19, so some details below may differ from current functionality
Dynamic Disk Pools vs. Disk Groups New DDP configuration What does that mean? Things to note SANtricity Web Services Proxy Web Proxy Container ...
Introduction Considerations Create configuration options Choice of query tool Show available options Query capacity range Manual selection of ...
Introduction Why LXD on BeeGFS (with or without NetApp E-Series) Get started Optimal BeeGFS settings HA BeeGFS client in LXD VMs on LXD server a...
It may not be easy to digest how BeeGFS with NetApp E-Series is usually configured.
NOTE: Since BeeGFS v7.3.3 there's an improved and self-contained monitoring package. There's no need to use this approach on BeeGFS v7.3.3 and beyond. See th...
Nomad Pack and Nomad BeeGFS Nomad Pack for InfluxDB on Nomad with BeeGFS Backup \& restore Using influx backup Conclusion
I have a small Nomad cluster which can access a BeeGFS filesystem.
Apptainer is based on the Singularity project.
Introduction
I'm supposed to be resting this week and that hasn't been working out… Still, I'll try to keep this one shorter than the previous two posts from this week.
Objective How I tested Kafka tests and results Random ASCII records StorageGRID audit log Protecting Kafka on a single site...
Multi-tiered storage in Kafka clusters How to leverage E-Series Performance vs. data protection overhead Sequential performance vs. lat...
HDFS Durability and External Protected Storage Does everyone need RF2 HDFS Erasure Coding Compression NFS gateway Snapsho...
While the ability to move files (or blocks) from and to other filesystems is nice, it isn't always necessary or desirable.
NetApp E-Series are fast-performing disk arrays frequently used by big data, analytics, video processing, NOSQL databases, and HPC applications. You can find...
BeeGFS 7.3.0 for ARM64 Attempt 1 Attempt 2 Video walk-through
Introduction Setup Scaling-out IO-intensive batch jobs Shared file system vs. file server vs. internal disk Scale-out batch jobs with Nomad I/O an...
Introduction What Kanister does Summary Demo
Introduction Use cases Getting started Options in a mixed environment Deploy and use BeeGFS CSI Data protection Summary Demo
Introduction Setup Generic batch job with I/O to parallel filesystem File format conversion Summary Demo
Introduction How it works Rest Server E-Series Dealing with the risk of storage-side snapshot rotation Storage efficiency Thi...
Introduction NetApp E-Series NetApp BeeGFS CSI Other CSI provisioners and non-CSI approaches NetApp SolidFire Cind...
NOTICE: all credentials and tokens on this page are samples, not leaked.
RAID 6 vs DDP DDP expansion Disk media refresh with DDP pools Demo
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
Summary Test results Configuration Elasticsearch data protection with EF-Series Workload description Performan...
Things are getting interesting Does EF-Series for Splunk on NetApp HCI make sense How does it work How does that compare with other HCI C...
Summary Why and when run BeeGFS in NetApp HCI VMs Aren't shared file systems complex to deploy and manage How do automation and virtualization help ...
Summary Why test EF280 performance from a VM VMFS vs. Raw Devices Manageability and iSCSI Cost of an All Flash backup tier ...
If you search for "iSCSI vs FC performance" it's not easy to find a recent like-for-like comparison from enterprise vendors. I've been puzzled by this and I ...
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
This is a two-part post:
This is more appropriate for a tweet, but anyway…
Background Why this is cool Catches File/object duality considerations Conclusion Demo
Introduction What's new in BeeGFS file-system events in BeeGFS v8 Dude, where's my gRPC server? Can BeeGFS watch server, erhm, client, ...
"Adjustments" Latest and greatest: "breaking changes" Are you telling me there's a chance? Thoughts Risk and commercial ...
Introduction Reference architectures High-level design and best practices What's new in Cloudera Base Deployment topology Sizin...
Introduction The problem Solutions Notes on MinIO Notes on VersityGW Benchmarking and testing VersityGW on scale-out file systems vs ...
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
Introduction Initiating and monitoring SolidFire backup-to-S3 jobs Initiation Status Progress Completion and result ...
Intro Using Kubernetes to backup non-Kubernetes volumes Dealing with alien filesystems Workflow for backup of non-K8s volumes on SolidFire using Vel...
Introduction
So, what filesystem block size does StorageGRID 11.8 use?
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
Introduction
Introduction Network Servers StorageGRID load balancer OS Storage Flash tier NL-SAS tier DDP vs RAID Gro...
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
What Config How Using Conclusion Appendix - External performance test
Objectives and tools Steps to set up backup with Kopia Steps on OS and SolidBackup Steps related to Kopia Ensuring SolidBackup an...
What is Simple Backups? Use Simple Backups for File-type backup with SolidFire clones mounted to a "backup VM" Backup sizes compared to Solid...
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
Why Automation Generate data and backup volumes Restore S3 backups to new SolidFire volumes Restore-related notes Cost estimati...
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
What, why and how HTTP Access from SQL Server Where does Docker come in Other S3 clients Backup use case Comp...
Introduction Backup to ONTAP S3 Network configuration Workflow Discussion Backup to ONTAP S3 DR to ONTAP S3 ...
Update (2024/06): I haven't tested this yet, but it seems after Velero AWS Plugin v1.9, ONTAP S3 users can no longer use Velero. One workaround for this is t...
Why "Elasticsearches"?
What
I've written about several ways we can take advantage of MinIO with NetApp E-Series back-ends, for example in the post on MinIO on HashiCorp Nomad with BeeGF...
Normally SolidFire 11 and 12 use Management Network for volume backup. Some users prefer to have backup flow over Storage Network.
Normally SolidFire 11 and 12 use Management Network for volume backup. Some users prefer to have backup flow over Storage Network.
I have a small Nomad cluster which can access a BeeGFS filesystem.
I'm supposed to be resting this week and that hasn't been working out… Still, I'll try to keep this one shorter than the previous two posts from this week.
How would we use SolidFire Backup to S3 with Object Lock-enabled buckets Practical observations How many S3 objects or accounts do we need ...
ONTAP has had S3 service for a while now. While ONTAP S3 isn't meant to take over large and complex S3 workloads in which NetApp StorageGRID excels, it is mo...
NOTICE: all credentials and tokens on this page are samples, not leaked.
In a recent post I wrote about S3 Select in StorageGRID 11.6.
This week I heard of a StorageGRID customer who had a query about data processing in the cloud. Probably instinctively, their first idea was to copy data to ...
It's very easy and works as you expected:
NOTICE: all credentials and tokens on this page are samples, not leaked.
Some two months ago I rewrote SGAC and released it as v0.1.
Create a bucket, say quay, and a set of S3 keys for one of your S3 users to use with this bucket.
Say you have a bucket called junk with "directory tree" (not really but…) several levels deep (junk/lev1/lev2) and want to do some ILM stuff on the stuff in ...
Create two buckets, source and destination, a PUT a test object with some junk tags to source/.
How it begun
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
In the previous post I explained how SolidFire's built-in backup/restore to/from S3 works and how we can automate it. This post is about doing less automatio...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
WTF is EON Mode What do I need to do to get Vertica EON Mode work with StorageGRID TLS certificate for HTTPS IP address for S3 API endp...
Docker Registry
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Previously I blogged about using Kasten with NetApp HCI and SolidFire, but I did not have time to examine another NetApp storage integration, namely that of ...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
"There's no documentation" is different from "there are no copy-paste examples".
This is more appropriate for a tweet, but anyway…
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
Introduction Initiating and monitoring SolidFire backup-to-S3 jobs Initiation Status Progress Completion and result ...
Intro Using Kubernetes to backup non-Kubernetes volumes Dealing with alien filesystems Workflow for backup of non-K8s volumes on SolidFire using Vel...
What is Verda Example with Redis Conclusion
Introduction Backup detail enhancements in Velero v1.13 Mapping Velero jobs to SolidFire volume and snapshot objects How many Veler...
Introduction Longer answer Other notes Disk snapshots and security E-Series vs. internal RAID Hardened repository volumes on E-Series w...
Introduction SolidFire backup to S3 MinIO compression Results Conclusions
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
Introduction WTF is CSI Snapshot Data Movement (CSI SDM) Why is that a Good Thing Get ready to use CSI SDM with NetApp Astra Triden...
Objectives and tools Steps to set up backup with Kopia Steps on OS and SolidBackup Steps related to Kopia Ensuring SolidBackup an...
What is Simple Backups? Use Simple Backups for File-type backup with SolidFire clones mounted to a "backup VM" Backup sizes compared to Solid...
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
What, why and how HTTP Access from SQL Server Where does Docker come in Other S3 clients Backup use case Comp...
Introduction Backup to ONTAP S3 Network configuration Workflow Discussion Backup to ONTAP S3 DR to ONTAP S3 ...
Update (2024/06): I haven't tested this yet, but it seems after Velero AWS Plugin v1.9, ONTAP S3 users can no longer use Velero. One workaround for this is t...
Table of Contents
Snapshot attributes in SolidFire Hashtable example Snapshot with attributes Using snapshot attributes Conclusion
AWS mountpoint-s3 Deploy Use cases for E-Series and SolidFire S3 bucket as backup mountpoint Sub-bucket allocation ...
Introduction Cold multi-volume backup without snapshots Group Snapshot-assisted multi-volume backup Backup multi-volume snapshot to S3 with...
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
Backup repository choices for Kasten with E-Series Veeam Repository S3 bucket NFS share Which one to use? Cost and performance Se...
Normally SolidFire 11 and 12 use Management Network for volume backup. Some users prefer to have backup flow over Storage Network.
Kubernetes-native RBAC S3 Object Lock support "Officialized" (Kanister) blueprints for SQL Server and PostgreSQL Operator aka PGO OpenStack and vSph...
How would we use SolidFire Backup to S3 with Object Lock-enabled buckets Practical observations How many S3 objects or accounts do we need ...
Introduction How it works Rest Server E-Series Dealing with the risk of storage-side snapshot rotation Storage efficiency Thi...
NOTICE: all credentials and tokens on this page are samples, not leaked.
It's very easy and works as you expected:
To answer the question quickly: logical backups make sense.
SolidFire can backup volumes to S3-compatible Object Storage. How to do it in parallel, I wrote about here.
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
In the previous post I explained how SolidFire's built-in backup/restore to/from S3 works and how we can automate it. This post is about doing less automatio...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Previously I blogged about using Kasten with NetApp HCI and SolidFire, but I did not have time to examine another NetApp storage integration, namely that of ...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Rancher and other Kubernetes users want to protect their applications and data. NetApp HCI and its underlying SolidFire storage are used by NetApp Trident to...
Introduction Show me Why? Thoughts Conclusion
This series of posts has several parts:
Introduction Situation Procedure Kubernetes Conclusion Appendix A - upsize remote and resize in Longhorny
Pull QoS policy from SolidFire into Trident back-end configuration for solidfire-san Exercise care What does the IOPS really do? What does all this ...
Introduction Slightly confusing SolidFire snapshot schedules Create a schedule Group vs. single One volume, multiple schedules FIFO settings ...
What replication monitoring? What does that mean? What can we see? Other implementation details Grafana aside Summary
Introduction SolidFire volume replication Failed and not-so-successful approaches Write workload at destination Node throughput ...
Introduction What exactly does Longhorny do? Longhorny walk-through Site-level actions Conclusion Demo
Introduction Use cases Feed Trident volume list to Velero Create backup-to-S3 jobs on SolidFire Set up cross-site replication for...
Introduction Mapping applications to Kubernetes PVCs with kubectl Mapping PVCs to storage with tridentctl Mapping Trident to SolidFire with scripts ...
Intro Other objectives What's new in SFC Rewrite Back-end database change Asynchronous execution Drop SolidFire Python SD...
Introduction
It took me a while
Introduction Fixing RBAC with a TLS-terminating reverse proxy Lua in reverse proxy path JSON-RPC Lua and JSON-RPC Complicate things...
Introduction Clone and analyze Example with Postgres writeBytes metric Cost issue Do we still need to clone those snapshots? How to minimize s...
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
Snapshot attributes in SolidFire Hashtable example Snapshot with attributes Using snapshot attributes Conclusion
Long story short, password rotation scripts should directly use the SANtricity (or Web Services Proxy, if you can't get directly to SANtricity) API and not t...
Introduction API Check TLS Traditional login JWTs Use SANtricity Bearer Token Demo References Conclusion
Dynamic Disk Pools vs. Disk Groups New DDP configuration What does that mean? Things to note SANtricity Web Services Proxy Web Proxy Container ...
There's a PowerShell script sfvid2nid.ps1 in my Awesome SolidFire repository on Github. It produces a table that shows the mapping of volume IDs to node IDs.
Why access Trident API Controller routes Trident resources Expose the Trident REST API Examples What about it Appendix: List of Trident Resour...
solidfire-operator is a Proof-of-Concept operator for Kubernetes built using Operator Framework.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
Today I got this error on Kubernetes v1.23.4 while trying out a Trident CLI command (tridentctl):
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
Just a few examples for those who struggle to get started.
Maintenance Mode is a relatively new SolidFire feature that takes a node in and out of the neutral. In other words, it nicely moves a node's services to rema...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
What's new in HCICollector v0.7 Improvements Setbacks What's next for HCICollector Unsolvable NetApp Trident Download HCI...
"There's no documentation" is different from "there are no copy-paste examples".
Hybrid Cloud Control (HCC) is a group of services - management plane, if you will - for out-of-band management of NetApp HCI, SolidFire and eSDS. Currently i...
Introduction EPA 4 EPA Collector-specific Details related to storage requirements What's next
Introduction SFC 2.1 Queries Summary
Introduction What's backwards compatible and what's not in InfluxDB 3 Evaluate with E-Series Performance Analyzer Other details Conclusion Appen...
Intro Other objectives What's new in SFC Rewrite Back-end database change Asynchronous execution Drop SolidFire Python SD...
Intro About QoS histograms on NetApp SolidFire Request Response What are these things? Bucket naming Should you use QoS histogram information?...
Telegraf for heavy lifting? PoC with PowerShell Conclusion Appendix A - Python version
WTF is SFC? Why bother when no one is using it? Progress so far Conclusion
WTF is SFC? Why bother when no one is using it? Progress so far Conclusion
Introduction Initiating and monitoring SolidFire backup-to-S3 jobs Initiation Status Progress Completion and result ...
You may have heard Grafana 11 is coming out soon.
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Problem statement Considerations First iteration Second iteration Conclusion
Introduction Configure SNMP trap destination in SANtricity OS Get E-Series MIB files and OID SANtricity SNMP walk SANtricity SNMP traps and trap e...
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
EPA v3.3.0 will be the next release of EPA and I'm aiming for two small improvements:
EPA v3.3.0 will be the next release of EPA and I'm aiming for two small improvements:
Why and when automate Cloud Sync?
EPA on Kubernetes and Nomad is here
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
E-Series Performance Analyzer (EPA) v3.0.0 collects MEL (Major Event Log) events and send them to InfluxDB. I think SANtricity syslog events have similar inf...
NetApp E-Series Prometheus Exporter
Should we use E-Series Performance Analyzer or SANtricity Web UI to monitor E-Series performance Various E-Series Performance Analyzer (EPA) notes ...
NOTE: Since BeeGFS v7.3.3 there's an improved and self-contained monitoring package. There's no need to use this approach on BeeGFS v7.3.3 and beyond. See th...
Nomad Pack and Nomad BeeGFS Nomad Pack for InfluxDB on Nomad with BeeGFS Backup \& restore Using influx backup Conclusion
What is SFC Making SolidFire Collector work with Kubernetes Appendix: Deploymennt for SFC and Graphite
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
In the first solidfire-exporter post I went through the first two steps required to gather SolidFire (or NetApp HCI) data and get it into Prometheus. I also ...
NetApp HCI compute nodes are normally monitored from mNode, which is a VM that fetches events from both storage and compute nodes.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
What's new in HCICollector v0.7 Improvements Setbacks What's next for HCICollector Unsolvable NetApp Trident Download HCI...
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
Summary Test results Configuration Elasticsearch data protection with EF-Series Workload description Performan...
Introduction Kubefire Simplified version of Longhorny focused on Kubernetes Automated replication service for SolidFire replication in ...
This series of posts has several parts:
Intro Using Kubernetes to backup non-Kubernetes volumes Dealing with alien filesystems Workflow for backup of non-K8s volumes on SolidFire using Vel...
What is Verda Example with Redis Conclusion
Introduction Backup detail enhancements in Velero v1.13 Mapping Velero jobs to SolidFire volume and snapshot objects How many Veler...
Here we go again…
Introduction KEDA concepts and components Scalers KEDA and persistent storage SolidFire E-Series Storage-related events ...
Introduction Digression Purpose Volume mode in PVC How does this help us with git clone problem Conclusion...
Introduction
Introduction
Table of Contents
Introduction Cold multi-volume backup without snapshots Group Snapshot-assisted multi-volume backup Backup multi-volume snapshot to S3 with...
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
I had thought the posts I wrote about Trident on ARM64 were enough to get almost everyone going, but it seems it's not hard to get stuck.
The official Trident documentation is okay, but it mentions no Rocky Linux.
Kubernetes-native RBAC S3 Object Lock support "Officialized" (Kanister) blueprints for SQL Server and PostgreSQL Operator aka PGO OpenStack and vSph...
Why access Trident API Controller routes Trident resources Expose the Trident REST API Examples What about it Appendix: List of Trident Resour...
One of more obvious characteristics of Persistent Volumes is they persist, i.e. survive pod(s) that use them until the claim for the PV itself is deleted, as...
Introduction
Introduction NetApp E-Series NetApp BeeGFS CSI Other CSI provisioners and non-CSI approaches NetApp SolidFire Cind...
Introduction Deploy Nomad with SolidFire Host Volumes Backup and restore Backup data from VM with SolidFire-based as Host Volumes Bac...
Today I got this error on Kubernetes v1.23.4 while trying out a Trident CLI command (tridentctl):
To answer the question quickly: logical backups make sense.
Latest & greatest NetApp Trident is out!
If I had a SolidFire array in a VM and container environment (which I do), I'd prefer to run Prometheus and Grafana in VMs, rather than cram the monitoring i...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
What Upgrade procedure Before Out with the old, in with the new Verify success Trident for ARM64 and other non-AMD64 ar...
While experimenting with SolidFire and Trident CSI failover for Kubernetes, I came across a challenge:
Introduction What does it do Storing and protecting your IoT data Object Stores for Photon IoT C2C (Cloud to Container) How to process IoT data up...
UPDATE Summary Introduction Comparison between PV Patching and Trident Volume Import approach Why only Scena...
UPDATE Summary Introduction Comparison between PV Patching and Trident Volume Import approach Why only Scena...
Intro Build \& Deploy What about s390x, ppc64le and other architectures Next steps Version info Notes on linux/s390x (Feb 25, 2021)
Problem Solutions Demo
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Rancher and other Kubernetes users want to protect their applications and data. NetApp HCI and its underlying SolidFire storage are used by NetApp Trident to...
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
Introduction
So, what filesystem block size does StorageGRID 11.8 use?
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
Introduction How to configure What do Kafka notifications look like Similarities and differences compared to Elasticsearch search integration Use ...
Introduction
Introduction Network Servers StorageGRID load balancer OS Storage Flash tier NL-SAS tier DDP vs RAID Gro...
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
What, why and how HTTP Access from SQL Server Where does Docker come in Other S3 clients Backup use case Comp...
Why "Elasticsearches"?
NOTICE: all credentials and tokens on this page are samples, not leaked.
In a recent post I wrote about S3 Select in StorageGRID 11.6.
This week I heard of a StorageGRID customer who had a query about data processing in the cloud. Probably instinctively, their first idea was to copy data to ...
NOTICE: all credentials and tokens on this page are samples, not leaked.
Some two months ago I rewrote SGAC and released it as v0.1.
Create a bucket, say quay, and a set of S3 keys for one of your S3 users to use with this bucket.
Say you have a bucket called junk with "directory tree" (not really but…) several levels deep (junk/lev1/lev2) and want to do some ILM stuff on the stuff in ...
Create two buckets, source and destination, a PUT a test object with some junk tags to source/.
How it begun
WTF is EON Mode What do I need to do to get Vertica EON Mode work with StorageGRID TLS certificate for HTTPS IP address for S3 API endp...
Docker Registry
Previously I blogged about using Kasten with NetApp HCI and SolidFire, but I did not have time to examine another NetApp storage integration, namely that of ...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
"There's no documentation" is different from "there are no copy-paste examples".
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
This series of posts has several parts:
Introduction Reinventing the wheel Components Workflow Expected outcome Next steps Security Quotas and ACLs Monitoring ...
What is Verda Example with Redis Conclusion
Introduction Backup detail enhancements in Velero v1.13 Mapping Velero jobs to SolidFire volume and snapshot objects How many Veler...
Introduction KEDA concepts and components Scalers KEDA and persistent storage SolidFire E-Series Storage-related events ...
Introduction WTF is CSI Snapshot Data Movement (CSI SDM) Why is that a Good Thing Get ready to use CSI SDM with NetApp Astra Triden...
I've written several posts about NetApp's BeeGFS CSI driver.
Introduction Digression Purpose Volume mode in PVC How does this help us with git clone problem Conclusion...
Introduction
Introduction
Table of Contents
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
This week NetApp released BeeGFS CSI driver v1.4.0 which adds support for newer Kubernetes and BeeGFS.
CSI choices for E-Series in a Kubernetes environment What's out there in terms of DAS CSI for Kubernetes Unique DAS approaches How ...
Introduction Non-CSI with Restic and NetApp BeeGFS CSI CSI with NetApp Trident What's new in 1.9 and 1.8 Velero on ARM64 Restic (ARM64)...
While reading the excellent article Why We Migrated from Kubernetes to Nomad (2021) it occurred to me I spotted some of the same advantages while working on ...
I had thought the posts I wrote about Trident on ARM64 were enough to get almost everyone going, but it seems it's not hard to get stuck.
NetApp E-Series are fast-performing disk arrays frequently used by big data, analytics, video processing, NOSQL databases, and HPC applications. You can find...
Why access Trident API Controller routes Trident resources Expose the Trident REST API Examples What about it Appendix: List of Trident Resour...
BeeGFS 7.3.0 for ARM64 Attempt 1 Attempt 2 Video walk-through
One of more obvious characteristics of Persistent Volumes is they persist, i.e. survive pod(s) that use them until the claim for the PV itself is deleted, as...
Introduction What Kanister does Summary Demo
Introduction Use cases Getting started Options in a mixed environment Deploy and use BeeGFS CSI Data protection Summary Demo
NOTICE: all credentials and tokens on this page are samples, not leaked.
Latest & greatest NetApp Trident is out!
If I had a SolidFire array in a VM and container environment (which I do), I'd prefer to run Prometheus and Grafana in VMs, rather than cram the monitoring i...
What Upgrade procedure Before Out with the old, in with the new Verify success Trident for ARM64 and other non-AMD64 ar...
Intro Build \& Deploy What about s390x, ppc64le and other architectures Next steps Version info Notes on linux/s390x (Feb 25, 2021)
Problem Solutions Demo
Background Why this is cool Catches File/object duality considerations Conclusion Demo
Introduction What's new in BeeGFS file-system events in BeeGFS v8 Dude, where's my gRPC server? Can BeeGFS watch server, erhm, client, ...
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
Introduction What is the OPEA project The stack Docker vs. Kubernetes Where's the storage? E-Series storage and solution stack ...
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
WTF is EConfig? What's new How I use EConfig DDP BeeGFS Troubles Conclusion Appendix A - BeeGFS sizer
Introduction
What Config How Using Conclusion Appendix - External performance test
I've written several posts about NetApp's BeeGFS CSI driver.
Problem statement Data replication Storage CSI drivers GPU compute nodes Performance monitoring Workflow
BeeGFS can work with different storage targets, so just like with Spectrum Scale it is possible to create a filesystem that spans across different disk media...
Maybe you've used an app (or an ONTAP feature) that makes use of the FPolicy API. FPolicy is proven in large and busy NAS environments, and has rich features...
While reading the excellent article Why We Migrated from Kubernetes to Nomad (2021) it occurred to me I spotted some of the same advantages while working on ...
Following my previous post on TensorStore with BeeGFS I thought I should revisit another item from my lengthy to-do list: filesystem compression.
TensorStore is a new C++ and Python library that provides a uniform API for reading and writing n-dimensional data.
Introduction Why LXD on BeeGFS (with or without NetApp E-Series) Get started Optimal BeeGFS settings HA BeeGFS client in LXD VMs on LXD server a...
It may not be easy to digest how BeeGFS with NetApp E-Series is usually configured.
NOTE: Since BeeGFS v7.3.3 there's an improved and self-contained monitoring package. There's no need to use this approach on BeeGFS v7.3.3 and beyond. See th...
Nomad Pack and Nomad BeeGFS Nomad Pack for InfluxDB on Nomad with BeeGFS Backup \& restore Using influx backup Conclusion
Nextflow configuration and environment variables allow us to make use of BeeGFS with E-Series for most demanding IO tasks.
Apptainer is based on the Singularity project.
While the ability to move files (or blocks) from and to other filesystems is nice, it isn't always necessary or desirable.
BeeGFS 7.3.0 for ARM64 Attempt 1 Attempt 2 Video walk-through
Introduction Setup Scaling-out IO-intensive batch jobs Shared file system vs. file server vs. internal disk Scale-out batch jobs with Nomad I/O an...
Introduction What Kanister does Summary Demo
Introduction Use cases Getting started Options in a mixed environment Deploy and use BeeGFS CSI Data protection Summary Demo
Introduction Setup Generic batch job with I/O to parallel filesystem File format conversion Summary Demo
Introduction NetApp E-Series NetApp BeeGFS CSI Other CSI provisioners and non-CSI approaches NetApp SolidFire Cind...
Summary Why and when run BeeGFS in NetApp HCI VMs Aren't shared file systems complex to deploy and manage How do automation and virtualization help ...
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
Introduction SolidFire backup to S3 MinIO compression Results Conclusions
Objectives and tools Steps to set up backup with Kopia Steps on OS and SolidBackup Steps related to Kopia Ensuring SolidBackup an...
What is Simple Backups? Use Simple Backups for File-type backup with SolidFire clones mounted to a "backup VM" Backup sizes compared to Solid...
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
Update (2024/06): I haven't tested this yet, but it seems after Velero AWS Plugin v1.9, ONTAP S3 users can no longer use Velero. One workaround for this is t...
Table of Contents
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
Backup repository choices for Kasten with E-Series Veeam Repository S3 bucket NFS share Which one to use? Cost and performance Se...
How would we use SolidFire Backup to S3 with Object Lock-enabled buckets Practical observations How many S3 objects or accounts do we need ...
Introduction How it works Rest Server E-Series Dealing with the risk of storage-side snapshot rotation Storage efficiency Thi...
NOTICE: all credentials and tokens on this page are samples, not leaked.
It's very easy and works as you expected:
Digital Ocean is a no-nonsense cloud provider that you've probably heard of.
To answer the question quickly: logical backups make sense.
SolidFire can backup volumes to S3-compatible Object Storage. How to do it in parallel, I wrote about here.
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
In the previous post I explained how SolidFire's built-in backup/restore to/from S3 works and how we can automate it. This post is about doing less automatio...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Previously I blogged about using Kasten with NetApp HCI and SolidFire, but I did not have time to examine another NetApp storage integration, namely that of ...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NetApp Cloud Backup Service backs up your ONTAP data to your Object Storage bucket located in the cloud (Amazon, Azure, Google Cloud).
Rancher and other Kubernetes users want to protect their applications and data. NetApp HCI and its underlying SolidFire storage are used by NetApp Trident to...
Background Firemox What it does, and doesn't (Stopping) scope creep Known issues and limitations Conclusion Demo and source c...
Problem Background Solution(s) Epilogue
Introduction Situation Procedure Kubernetes Conclusion Appendix A - upsize remote and resize in Longhorny
Telegraf for heavy lifting? PoC with PowerShell Conclusion Appendix A - Python version
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
This is the first of possibly several posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Get NetApp.SANtricity module for PowerShell 5.1 Install and load Use End Appendix A - Known issues \& workarounds
Introduction SANtricity API methods related to scrubbing, scanning, fixing data issues Media scan in Web UI Relevant API methods Implementation ...
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Introduction Software stack Getting E-Series events and metrics into PRTG Generic probes SNMP walk SNMP traps Custom sens...
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
Snapshot attributes in SolidFire Hashtable example Snapshot with attributes Using snapshot attributes Conclusion
Long story short, password rotation scripts should directly use the SANtricity (or Web Services Proxy, if you can't get directly to SANtricity) API and not t...
Dynamic Disk Pools vs. Disk Groups New DDP configuration What does that mean? Things to note SANtricity Web Services Proxy Web Proxy Container ...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Just a few examples for those who struggle to get started.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
SolidFire can backup volumes to S3-compatible Object Storage. How to do it in parallel, I wrote about here.
While experimenting with SolidFire and Trident CSI failover for Kubernetes, I came across a challenge:
This is a nice Christmas present as far as I am concerned, because it's been a while since SolidFire PowerShell tools, sfcli and their respective SDKs v1.5 h...
Hybrid Cloud Control (HCC) is a group of services - management plane, if you will - for out-of-band management of NetApp HCI, SolidFire and eSDS. Currently i...
Say we have a Volume ID 321 with a storage QoS Policy ID 5, and need to run a temporary job that would benefit from a different Storage QoS Policy (higher or...
Introduction Kubefire Simplified version of Longhorny focused on Kubernetes Automated replication service for SolidFire replication in ...
Telegraf for heavy lifting? PoC with PowerShell Conclusion Appendix A - Python version
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
EPA on Kubernetes and Nomad is here
Should we use E-Series Performance Analyzer or SANtricity Web UI to monitor E-Series performance Various E-Series Performance Analyzer (EPA) notes ...
Dynamic Disk Pools vs. Disk Groups New DDP configuration What does that mean? Things to note SANtricity Web Services Proxy Web Proxy Container ...
What is SFC Making SolidFire Collector work with Kubernetes Appendix: Deploymennt for SFC and Graphite
solidfire-operator is a Proof-of-Concept operator for Kubernetes built using Operator Framework.
Introduction
Just a few examples for those who struggle to get started.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Some two months ago I rewrote SGAC and released it as v0.1.
How it begun
NetApp HCI compute nodes are normally monitored from mNode, which is a VM that fetches events from both storage and compute nodes.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
What's new in HCICollector v0.7 Improvements Setbacks What's next for HCICollector Unsolvable NetApp Trident Download HCI...
This is a nice Christmas present as far as I am concerned, because it's been a while since SolidFire PowerShell tools, sfcli and their respective SDKs v1.5 h...
Hybrid Cloud Control (HCC) is a group of services - management plane, if you will - for out-of-band management of NetApp HCI, SolidFire and eSDS. Currently i...
This series of posts has several parts:
Introduction Situation Procedure Kubernetes Conclusion Appendix A - upsize remote and resize in Longhorny
Introduction
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
This is the first of possibly several posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Get NetApp.SANtricity module for PowerShell 5.1 Install and load Use End Appendix A - Known issues \& workarounds
Introduction Inferencing with SolidFire Examples Making use of iSCSI Share data with a parallel file system Share ...
Why Automation Generate data and backup volumes Restore S3 backups to new SolidFire volumes Restore-related notes Cost estimati...
Introduction API Check TLS Traditional login JWTs Use SANtricity Bearer Token Demo References Conclusion
solidfire-operator is a Proof-of-Concept operator for Kubernetes built using Operator Framework.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
Just a few examples for those who struggle to get started.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
SolidFire can backup volumes to S3-compatible Object Storage. How to do it in parallel, I wrote about here.
NetApp Hybrid Cloud Control (HCC) lets you access volume details to a slightly greater detail than the SolidFire Web UI. One additional detail that we are in...
This is a nice Christmas present as far as I am concerned, because it's been a while since SolidFire PowerShell tools, sfcli and their respective SDKs v1.5 h...
Say we have a Volume ID 321 with a storage QoS Policy ID 5, and need to run a temporary job that would benefit from a different Storage QoS Policy (higher or...
The Provider is now available from the official Terraform registry. This means we no longer need to download and build it manually. It is also easy to use it...
Introduction Reinventing the wheel Components Workflow Expected outcome Next steps Security Quotas and ACLs Monitoring ...
Here we go again…
Introduction KEDA concepts and components Scalers KEDA and persistent storage SolidFire E-Series Storage-related events ...
Introduction
I've written several posts about NetApp's BeeGFS CSI driver.
Introduction Digression Purpose Volume mode in PVC How does this help us with git clone problem Conclusion...
Now that Azure Linux is out, maybe some SolidFire users wonder if Azure Linux iSCSI can connect to SolidFire targets?
Table of Contents
EPA on Kubernetes and Nomad is here
Latest & greatest NetApp Trident is out!
While experimenting with SolidFire and Trident CSI failover for Kubernetes, I came across a challenge:
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Earlier this week I spotted the advice to not select a VM host when deploying Rancher worker VMs to a vSphere environment where DRS is enabled, because "DRS ...
solid-rancher is a Github repo I created to organize and enrich information related to Rancher on SolidFire (and NetApp HCI in general).
Introduction VMware's calculator (KB 96426) Example for NetApp HCI Conclusion
Introduction Storage options exposed in Virtual Manager Filesystem directory Physical disk device Preformatted block device ...
Introduction Challenges with vSphere 8 on NetApp HCI Alternatives NetApp HCI storage and data migration Summary Appendix A - VirtualBox Append...
One annoyance with Active IQ connectivity from Hybrid Cloud Control for SolidFire/NetApp HCI/eSDS is that it's not easy to tell what's going on with it when ...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Maintenance Mode is a relatively new SolidFire feature that takes a node in and out of the neutral. In other words, it nicely moves a node's services to rema...
NetApp HCI compute nodes are normally monitored from mNode, which is a VM that fetches events from both storage and compute nodes.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
What's new in HCICollector v0.7 Improvements Setbacks What's next for HCICollector Unsolvable NetApp Trident Download HCI...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NetApp Cloud Backup Service backs up your ONTAP data to your Object Storage bucket located in the cloud (Amazon, Azure, Google Cloud).
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
Summary Test results Configuration Elasticsearch data protection with EF-Series Workload description Performan...
Summary Why and when run BeeGFS in NetApp HCI VMs Aren't shared file systems complex to deploy and manage How do automation and virtualization help ...
This comes up every so often:
Hybrid Cloud Control (HCC) is a group of services - management plane, if you will - for out-of-band management of NetApp HCI, SolidFire and eSDS. Currently i...
SolidFire Management Node (aka mNode) is a VM that runs Hybrid Cloud Services (various "management stuff".) Let's say we wanted to collect and analyze those ...
solid-rancher is a Github repo I created to organize and enrich information related to Rancher on SolidFire (and NetApp HCI in general).
Who wants it and why? Perl for the win! Features Effort Appendix A: what works and how Appendix B: observations, problems, solutions Appendix ...
I wrote about Windows Server 2025 here.
Introduction How Other SolidFire-related tips Conclusion
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
This is the first of possibly several posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Problem statement E-Series side Ubuntu side Hardware and software stack Setup workflow Tips and tricks SANtricity Host settings ...
Rocky Linux 8 and 9 have been added to the NetApp E-Series interoperability matrix starting with SANtricity 11.70.
Normally SolidFire 11 and 12 use Management Network for volume backup. Some users prefer to have backup flow over Storage Network.
The official Trident documentation is okay, but it mentions no Rocky Linux.
Configure Proxmox 7.1 with SolidFire 12.3 SolidFire Demo VM on Proxmox
Introduction Deploy Nomad with SolidFire Host Volumes Backup and restore Backup data from VM with SolidFire-based as Host Volumes Bac...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
In the post that compares SolidFire Protection Domains with Availability Zones I had this illustration of network connectivity among SolidFire v12 cluster no...
Things are getting interesting Does EF-Series for Splunk on NetApp HCI make sense How does it work How does that compare with other HCI C...
If you search for "iSCSI vs FC performance" it's not easy to find a recent like-for-like comparison from enterprise vendors. I've been puzzled by this and I ...
Problem Background Solution(s) Epilogue
Introduction Kubefire Simplified version of Longhorny focused on Kubernetes Automated replication service for SolidFire replication in ...
Introduction
Pull QoS policy from SolidFire into Trident back-end configuration for solidfire-san Exercise care What does the IOPS really do? What does all this ...
Introduction Slightly confusing SolidFire snapshot schedules Create a schedule Group vs. single One volume, multiple schedules FIFO settings ...
What replication monitoring? What does that mean? What can we see? Other implementation details Grafana aside Summary
Introduction SolidFire volume replication Failed and not-so-successful approaches Write workload at destination Node throughput ...
Introduction What exactly does Longhorny do? Longhorny walk-through Site-level actions Conclusion Demo
Introduction Use cases Feed Trident volume list to Velero Create backup-to-S3 jobs on SolidFire Set up cross-site replication for...
Introduction Mapping applications to Kubernetes PVCs with kubectl Mapping PVCs to storage with tridentctl Mapping Trident to SolidFire with scripts ...
Introduction
It took me a while
If you want to develop or automate E-Series but aren't always connected, you may want to work offline with Swagger API files.
SolidFire doesn't have an OpenAPI interface. See here.
Dynamic Disk Pools vs. Disk Groups New DDP configuration What does that mean? Things to note SANtricity Web Services Proxy Web Proxy Container ...
While the ability to move files (or blocks) from and to other filesystems is nice, it isn't always necessary or desirable.
Introduction EPA 4 EPA Collector-specific Details related to storage requirements What's next
Introduction What's backwards compatible and what's not in InfluxDB 3 Evaluate with E-Series Performance Analyzer Other details Conclusion Appen...
Telegraf for heavy lifting? PoC with PowerShell Conclusion Appendix A - Python version
Introduction
WTF is SFC? Why bother when no one is using it? Progress so far Conclusion
Introduction Environment Tests Results Other performance views Conclusion
Why overprovisioning exists Who needs this BeeGFS example Who doesn't need this Impact on capacity sizing Impact on deployment ...
I've written about several ways we can take advantage of MinIO with NetApp E-Series back-ends, for example in the post on MinIO on HashiCorp Nomad with BeeGF...
Oracle TimesTen XE Classic v22.1 has quite a few requirements and settings related to memory and storage. Some attributes directly and indirectly related to ...
There's a PowerShell script sfvid2nid.ps1 in my Awesome SolidFire repository on Github. It produces a table that shows the mapping of volume IDs to node IDs.
ONTAP has had S3 service for a while now. While ONTAP S3 isn't meant to take over large and complex S3 workloads in which NetApp StorageGRID excels, it is mo...
In recent weeks I've done a fair amount of reading about log management solutions, and I have to say the quality of technical material related to Splunk and ...
Summary Why and when run BeeGFS in NetApp HCI VMs Aren't shared file systems complex to deploy and manage How do automation and virtualization help ...
Summary Why test EF280 performance from a VM VMFS vs. Raw Devices Manageability and iSCSI Cost of an All Flash backup tier ...
If you search for "iSCSI vs FC performance" it's not easy to find a recent like-for-like comparison from enterprise vendors. I've been puzzled by this and I ...
Intro Other objectives What's new in SFC Rewrite Back-end database change Asynchronous execution Drop SolidFire Python SD...
EPA v3.3.0 will be the next release of EPA and I'm aiming for two small improvements:
Why and when automate Cloud Sync?
EPA on Kubernetes and Nomad is here
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
How it begun
In the first solidfire-exporter post I went through the first two steps required to gather SolidFire (or NetApp HCI) data and get it into Prometheus. I also ...
NetApp HCI compute nodes are normally monitored from mNode, which is a VM that fetches events from both storage and compute nodes.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
What's new in HCICollector v0.7 Improvements Setbacks What's next for HCICollector Unsolvable NetApp Trident Download HCI...
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
Summary Test results Configuration Elasticsearch data protection with EF-Series Workload description Performan...
Introduction Approach Steps One or more instances Prepare your box Clone Harvest repo or download pre-built container image ...
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
Introduction
Update (2024/06): I haven't tested this yet, but it seems after Velero AWS Plugin v1.9, ONTAP S3 users can no longer use Velero. One workaround for this is t...
A workaround for rethinning Create multiple NFS shares for ESXi Mount NFS shares in ESXi Create a VM with extra data disk on one of NFS shares Ens...
ONTAP has had S3 service for a while now. While ONTAP S3 isn't meant to take over large and complex S3 workloads in which NetApp StorageGRID excels, it is mo...
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
Introduction What does it do Storing and protecting your IoT data Object Stores for Photon IoT C2C (Cloud to Container) How to process IoT data up...
Problem Solutions Demo
NetApp Cloud Backup Service backs up your ONTAP data to your Object Storage bucket located in the cloud (Amazon, Azure, Google Cloud).
Introduction Kubefire Simplified version of Longhorny focused on Kubernetes Automated replication service for SolidFire replication in ...
This series of posts has several parts:
Introduction Situation Procedure Kubernetes Conclusion Appendix A - upsize remote and resize in Longhorny
What replication monitoring? What does that mean? What can we see? Other implementation details Grafana aside Summary
Introduction SolidFire volume replication Failed and not-so-successful approaches Write workload at destination Node throughput ...
Introduction What exactly does Longhorny do? Longhorny walk-through Site-level actions Conclusion Demo
Introduction Use cases Feed Trident volume list to Velero Create backup-to-S3 jobs on SolidFire Set up cross-site replication for...
Introduction Mapping applications to Kubernetes PVCs with kubectl Mapping PVCs to storage with tridentctl Mapping Trident to SolidFire with scripts ...
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
NOTICE: all credentials and tokens on this page are samples, not leaked.
Digital Ocean is a no-nonsense cloud provider that you've probably heard of.
Introduction EPA 4 EPA Collector-specific Details related to storage requirements What's next
Introduction SFC 2.1 Queries Summary
Intro Other objectives What's new in SFC Rewrite Back-end database change Asynchronous execution Drop SolidFire Python SD...
Intro About QoS histograms on NetApp SolidFire Request Response What are these things? Bucket naming Should you use QoS histogram information?...
Telegraf for heavy lifting? PoC with PowerShell Conclusion Appendix A - Python version
WTF is SFC? Why bother when no one is using it? Progress so far Conclusion
Introduction Initiating and monitoring SolidFire backup-to-S3 jobs Initiation Status Progress Completion and result ...
You may have heard Grafana 11 is coming out soon.
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
EPA on Kubernetes and Nomad is here
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
Should we use E-Series Performance Analyzer or SANtricity Web UI to monitor E-Series performance Various E-Series Performance Analyzer (EPA) notes ...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Introduction Show me Why? Thoughts Conclusion
Introduction
Introduction Slightly confusing SolidFire snapshot schedules Create a schedule Group vs. single One volume, multiple schedules FIFO settings ...
What is Verda Example with Redis Conclusion
Introduction Backup detail enhancements in Velero v1.13 Mapping Velero jobs to SolidFire volume and snapshot objects How many Veler...
Introduction Clone and analyze Example with Postgres writeBytes metric Cost issue Do we still need to clone those snapshots? How to minimize s...
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Problem statement Considerations First iteration Second iteration Conclusion
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Introduction WTF is CSI Snapshot Data Movement (CSI SDM) Why is that a Good Thing Get ready to use CSI SDM with NetApp Astra Triden...
Snapshot attributes in SolidFire Hashtable example Snapshot with attributes Using snapshot attributes Conclusion
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
SolidFire vs. Ransomware
Intro Using Kubernetes to backup non-Kubernetes volumes Dealing with alien filesystems Workflow for backup of non-K8s volumes on SolidFire using Vel...
What is Verda Example with Redis Conclusion
Introduction Backup detail enhancements in Velero v1.13 Mapping Velero jobs to SolidFire volume and snapshot objects How many Veler...
Introduction Longer answer Other notes Disk snapshots and security E-Series vs. internal RAID Hardened repository volumes on E-Series w...
Introduction SolidFire backup to S3 MinIO compression Results Conclusions
Objectives and tools Steps to set up backup with Kopia Steps on OS and SolidBackup Steps related to Kopia Ensuring SolidBackup an...
What is Simple Backups? Use Simple Backups for File-type backup with SolidFire clones mounted to a "backup VM" Backup sizes compared to Solid...
Why Automation Generate data and backup volumes Restore S3 backups to new SolidFire volumes Restore-related notes Cost estimati...
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
Introduction Backup to ONTAP S3 Network configuration Workflow Discussion Backup to ONTAP S3 DR to ONTAP S3 ...
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
SolidFire can backup volumes to S3-compatible Object Storage. How to do it in parallel, I wrote about here.
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
This is a two-part post:
Introduction How to configure What do Kafka notifications look like Similarities and differences compared to Elasticsearch search integration Use ...
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
Why "Elasticsearches"?
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
NOTICE: all credentials and tokens on this page are samples, not leaked.
Some two months ago I rewrote SGAC and released it as v0.1.
Summary Test results Configuration Elasticsearch data protection with EF-Series Workload description Performan...
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
Intro Using Kubernetes to backup non-Kubernetes volumes Dealing with alien filesystems Workflow for backup of non-K8s volumes on SolidFire using Vel...
What is Verda Example with Redis Conclusion
Introduction Backup detail enhancements in Velero v1.13 Mapping Velero jobs to SolidFire volume and snapshot objects How many Veler...
Introduction WTF is CSI Snapshot Data Movement (CSI SDM) Why is that a Good Thing Get ready to use CSI SDM with NetApp Astra Triden...
Update (2024/06): I haven't tested this yet, but it seems after Velero AWS Plugin v1.9, ONTAP S3 users can no longer use Velero. One workaround for this is t...
Table of Contents
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
Introduction Non-CSI with Restic and NetApp BeeGFS CSI CSI with NetApp Trident What's new in 1.9 and 1.8 Velero on ARM64 Restic (ARM64)...
NOTICE: all credentials and tokens on this page are samples, not leaked.
What is a volume created by Volume Copy operation How does it work? Progress Reserve size Reserve location Priority Automating Volume Copy A...
If you want to develop or automate E-Series but aren't always connected, you may want to work offline with Swagger API files.
If you want to develop or automate E-Series but aren't always connected, you may want to work offline with Swagger API files.
Introduction SANtricity API methods related to scrubbing, scanning, fixing data issues Media scan in Web UI Relevant API methods Implementation ...
Introduction Longer answer Other notes Disk snapshots and security E-Series vs. internal RAID Hardened repository volumes on E-Series w...
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Why overprovisioning exists Who needs this BeeGFS example Who doesn't need this Impact on capacity sizing Impact on deployment ...
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
NetApp E-Series Prometheus Exporter
Long story short, password rotation scripts should directly use the SANtricity (or Web Services Proxy, if you can't get directly to SANtricity) API and not t...
Introduction API Check TLS Traditional login JWTs Use SANtricity Bearer Token Demo References Conclusion
Introduction SMB and NFS data migration Shell scripts and utilities XCP Elaborate schemes Enterprise software Example...
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
NOTICE: all credentials and tokens on this page are samples, not leaked.
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
AWS mountpoint-s3 Deploy Use cases for E-Series and SolidFire S3 bucket as backup mountpoint Sub-bucket allocation ...
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
Problem statement Data replication Storage CSI drivers GPU compute nodes Performance monitoring Workflow
Introduction Setup Generic batch job with I/O to parallel filesystem File format conversion Summary Demo
Pull QoS policy from SolidFire into Trident back-end configuration for solidfire-san Exercise care What does the IOPS really do? What does all this ...
Introduction Slightly confusing SolidFire snapshot schedules Create a schedule Group vs. single One volume, multiple schedules FIFO settings ...
What replication monitoring? What does that mean? What can we see? Other implementation details Grafana aside Summary
Introduction SolidFire volume replication Failed and not-so-successful approaches Write workload at destination Node throughput ...
Introduction What exactly does Longhorny do? Longhorny walk-through Site-level actions Conclusion Demo
Introduction Use cases Feed Trident volume list to Velero Create backup-to-S3 jobs on SolidFire Set up cross-site replication for...
Introduction Mapping applications to Kubernetes PVCs with kubectl Mapping PVCs to storage with tridentctl Mapping Trident to SolidFire with scripts ...
Intro About QoS histograms on NetApp SolidFire Request Response What are these things? Bucket naming Should you use QoS histogram information?...
WTF is Milvus Storage-related stuff Meta storage (etcd) Logs and queues Object store Storage efficiency High availabi...
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
E-Series Performance Analyzer (EPA) v3.0.0 collects MEL (Major Event Log) events and send them to InfluxDB. I think SANtricity syslog events have similar inf...
Configure SANtricity to send array events to a remote syslog server
NOTICE: all credentials and tokens on this page are samples, not leaked.
Some two months ago I rewrote SGAC and released it as v0.1.
How it begun
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
SolidFire Management Node (aka mNode) is a VM that runs Hybrid Cloud Services (various "management stuff".) Let's say we wanted to collect and analyze those ...
"Adjustments" Latest and greatest: "breaking changes" Are you telling me there's a chance? Thoughts Risk and commercial ...
Introduction The problem Solutions Notes on MinIO Notes on VersityGW Benchmarking and testing VersityGW on scale-out file systems vs ...
While using ehm, a famous S3 server, I got annoyed by this stupid red dot.
Introduction SolidFire backup to S3 MinIO compression Results Conclusions
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
I've written about several ways we can take advantage of MinIO with NetApp E-Series back-ends, for example in the post on MinIO on HashiCorp Nomad with BeeGF...
I have a small Nomad cluster which can access a BeeGFS filesystem.
Telegraf for heavy lifting? PoC with PowerShell Conclusion Appendix A - Python version
WTF is SFC? Why bother when no one is using it? Progress so far Conclusion
Introduction Initiating and monitoring SolidFire backup-to-S3 jobs Initiation Status Progress Completion and result ...
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
EPA on Kubernetes and Nomad is here
Should we use E-Series Performance Analyzer or SANtricity Web UI to monitor E-Series performance Various E-Series Performance Analyzer (EPA) notes ...
NOTE: Since BeeGFS v7.3.3 there's an improved and self-contained monitoring package. There's no need to use this approach on BeeGFS v7.3.3 and beyond. See th...
Nomad Pack and Nomad BeeGFS Nomad Pack for InfluxDB on Nomad with BeeGFS Backup \& restore Using influx backup Conclusion
Introduction What's backwards compatible and what's not in InfluxDB 3 Evaluate with E-Series Performance Analyzer Other details Conclusion Appen...
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
EPA v3.3.0 will be the next release of EPA and I'm aiming for two small improvements:
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
EPA on Kubernetes and Nomad is here
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
Should we use E-Series Performance Analyzer or SANtricity Web UI to monitor E-Series performance Various E-Series Performance Analyzer (EPA) notes ...
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
Introduction What is the OPEA project The stack Docker vs. Kubernetes Where's the storage? E-Series storage and solution stack ...
Introduction MCP Use cases? Get, set, and security Conclusion Additional reading
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
Introduction Reinventing the wheel Components Workflow Expected outcome Next steps Security Quotas and ACLs Monitoring ...
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
Introduction Inferencing with SolidFire Examples Making use of iSCSI Share data with a parallel file system Share ...
So… I don't use Generative AI.
Nextflow configuration and environment variables allow us to make use of BeeGFS with E-Series for most demanding IO tasks.
While the ability to move files (or blocks) from and to other filesystems is nice, it isn't always necessary or desirable.
Introduction Setup Scaling-out IO-intensive batch jobs Shared file system vs. file server vs. internal disk Scale-out batch jobs with Nomad I/O an...
Introduction Setup Generic batch job with I/O to parallel filesystem File format conversion Summary Demo
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Introduction
NOTICE: all credentials and tokens on this page are samples, not leaked.
This week I heard of a StorageGRID customer who had a query about data processing in the cloud. Probably instinctively, their first idea was to copy data to ...
Introduction Walk-through And now… Conclusion Appendix A: demo Animated GIF (no playback control) Video demo with voice-over ...
Introduction What it is What it does IIS Setup Why this matters What about it? Conclusion
I wrote about Windows Server 2025 here.
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
This is the first of possibly several posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Get NetApp.SANtricity module for PowerShell 5.1 Install and load Use End Appendix A - Known issues \& workarounds
Introduction General notes on NTFS rehinning and SolidFire QoS-related tips Prepare Windows host volume SDelete SDelete with Windows gu...
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
Introduction Software stack Getting E-Series events and metrics into PRTG Generic probes SNMP walk SNMP traps Custom sens...
Introduction Non-CSI with Restic and NetApp BeeGFS CSI CSI with NetApp Trident What's new in 1.9 and 1.8 Velero on ARM64 Restic (ARM64)...
NOTICE: all credentials and tokens on this page are samples, not leaked.
This is speculative and I haven't tried it, but it looks very interesting.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
The Provider is now available from the official Terraform registry. This means we no longer need to download and build it manually. It is also easy to use it...
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
Why "Elasticsearches"?
NOTICE: all credentials and tokens on this page are samples, not leaked.
Some two months ago I rewrote SGAC and released it as v0.1.
Summary Test results Configuration Elasticsearch data protection with EF-Series Workload description Performan...
Here we go again…
Introduction
Introduction Non-CSI with Restic and NetApp BeeGFS CSI CSI with NetApp Trident What's new in 1.9 and 1.8 Velero on ARM64 Restic (ARM64)...
I had thought the posts I wrote about Trident on ARM64 were enough to get almost everyone going, but it seems it's not hard to get stuck.
BeeGFS 7.3.0 for ARM64 Attempt 1 Attempt 2 Video walk-through
Introduction What does it do Storing and protecting your IoT data Object Stores for Photon IoT C2C (Cloud to Container) How to process IoT data up...
Intro Build \& Deploy What about s390x, ppc64le and other architectures Next steps Version info Notes on linux/s390x (Feb 25, 2021)
Introduction Approach Steps One or more instances Prepare your box Clone Harvest repo or download pre-built container image ...
NetApp E-Series Prometheus Exporter
NOTE: Since BeeGFS v7.3.3 there's an improved and self-contained monitoring package. There's no need to use this approach on BeeGFS v7.3.3 and beyond. See th...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
In the first solidfire-exporter post I went through the first two steps required to gather SolidFire (or NetApp HCI) data and get it into Prometheus. I also ...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NetApp E-Series Prometheus Exporter
Should we use E-Series Performance Analyzer or SANtricity Web UI to monitor E-Series performance Various E-Series Performance Analyzer (EPA) notes ...
NOTE: Since BeeGFS v7.3.3 there's an improved and self-contained monitoring package. There's no need to use this approach on BeeGFS v7.3.3 and beyond. See th...
Nomad Pack and Nomad BeeGFS Nomad Pack for InfluxDB on Nomad with BeeGFS Backup \& restore Using influx backup Conclusion
There's a PowerShell script sfvid2nid.ps1 in my Awesome SolidFire repository on Github. It produces a table that shows the mapping of volume IDs to node IDs.
What is SFC Making SolidFire Collector work with Kubernetes Appendix: Deploymennt for SFC and Graphite
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Introduction Walk-through And now… Conclusion Appendix A: demo Animated GIF (no playback control) Video demo with voice-over ...
Introduction What it is What it does IIS Setup Why this matters What about it? Conclusion
Requirement Workflow Storage considerations Tools
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
This is the first of possibly several posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Introduction Challenges with vSphere 8 on NetApp HCI Alternatives NetApp HCI storage and data migration Summary Appendix A - VirtualBox Append...
Introduction What's backwards compatible and what's not in InfluxDB 3 Evaluate with E-Series Performance Analyzer Other details Conclusion Appen...
Introduction
What replication monitoring? What does that mean? What can we see? Other implementation details Grafana aside Summary
Introduction SolidFire volume replication Failed and not-so-successful approaches Write workload at destination Node throughput ...
Intro Other objectives What's new in SFC Rewrite Back-end database change Asynchronous execution Drop SolidFire Python SD...
Introduction Initiating and monitoring SolidFire backup-to-S3 jobs Initiation Status Progress Completion and result ...
You may have heard Grafana 11 is coming out soon.
Introduction VMware's calculator (KB 96426) Example for NetApp HCI Conclusion
Introduction Challenges with vSphere 8 on NetApp HCI Alternatives NetApp HCI storage and data migration Summary Appendix A - VirtualBox Append...
A workaround for rethinning Create multiple NFS shares for ESXi Mount NFS shares in ESXi Create a VM with extra data disk on one of NFS shares Ens...
NetApp E-Series are fast-performing disk arrays frequently used by big data, analytics, video processing, NOSQL databases, and HPC applications. You can find...
This comes up every so often:
WTF is EConfig? What's new How I use EConfig DDP BeeGFS Troubles Conclusion Appendix A - BeeGFS sizer
NOTE: the Web site with this tool was improved and updated on 2024/04/19, so some details below may differ from current functionality
Introduction Considerations Create configuration options Choice of query tool Show available options Query capacity range Manual selection of ...
It may not be easy to digest how BeeGFS with NetApp E-Series is usually configured.
Most cloud users know about the various options to rent cloud compute resources.
In recent weeks I've done a fair amount of reading about log management solutions, and I have to say the quality of technical material related to Splunk and ...
Introduction
The official Trident documentation is okay, but it mentions no Rocky Linux.
Introduction NetApp E-Series NetApp BeeGFS CSI Other CSI provisioners and non-CSI approaches NetApp SolidFire Cind...
Introduction Deploy Nomad with SolidFire Host Volumes Backup and restore Backup data from VM with SolidFire-based as Host Volumes Bac...
What Upgrade procedure Before Out with the old, in with the new Verify success Trident for ARM64 and other non-AMD64 ar...
Docker Registry
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
Digital Ocean is a no-nonsense cloud provider that you've probably heard of.
NOTICE: all credentials and tokens on this page are samples, not leaked.
Some two months ago I rewrote SGAC and released it as v0.1.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
How it begun
Problem Background Solution(s) Epilogue
Busybodies@work I want 123456 Ending Appendix A: recommended low-quality password settings for pwquality.conf
Introduction Challenges with vSphere 8 on NetApp HCI Alternatives NetApp HCI storage and data migration Summary Appendix A - VirtualBox Append...
Now that Azure Linux is out, maybe some SolidFire users wonder if Azure Linux iSCSI can connect to SolidFire targets?
The official Trident documentation is okay, but it mentions no Rocky Linux.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
EPA on Kubernetes and Nomad is here
While reading the excellent article Why We Migrated from Kubernetes to Nomad (2021) it occurred to me I spotted some of the same advantages while working on ...
I have a small Nomad cluster which can access a BeeGFS filesystem.
Introduction Setup Scaling-out IO-intensive batch jobs Shared file system vs. file server vs. internal disk Scale-out batch jobs with Nomad I/O an...
Introduction Setup Generic batch job with I/O to parallel filesystem File format conversion Summary Demo
Introduction Deploy Nomad with SolidFire Host Volumes Backup and restore Backup data from VM with SolidFire-based as Host Volumes Bac...
Introduction Cold multi-volume backup without snapshots Group Snapshot-assisted multi-volume backup Backup multi-volume snapshot to S3 with...
EPA v3.3.0 will be the next release of EPA and I'm aiming for two small improvements:
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
SolidFire vs. Ransomware
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
AWS mountpoint-s3 Deploy Use cases for E-Series and SolidFire S3 bucket as backup mountpoint Sub-bucket allocation ...
Introduction Cold multi-volume backup without snapshots Group Snapshot-assisted multi-volume backup Backup multi-volume snapshot to S3 with...
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
SolidFire vs. Ransomware
Introduction Existing material Related posts on this blog Observations TB per day Events per day Sizing challenges ...
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Problem statement Considerations First iteration Second iteration Conclusion
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
Problem statement E-Series side Ubuntu side Hardware and software stack Setup workflow Tips and tricks SANtricity Host settings ...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Earlier this week I spotted the advice to not select a VM host when deploying Rancher worker VMs to a vSphere environment where DRS is enabled, because "DRS ...
solid-rancher is a Github repo I created to organize and enrich information related to Rancher on SolidFire (and NetApp HCI in general).
One annoyance with Active IQ connectivity from Hybrid Cloud Control for SolidFire/NetApp HCI/eSDS is that it's not easy to tell what's going on with it when ...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Maintenance Mode is a relatively new SolidFire feature that takes a node in and out of the neutral. In other words, it nicely moves a node's services to rema...
Hybrid Cloud Control (HCC) is a group of services - management plane, if you will - for out-of-band management of NetApp HCI, SolidFire and eSDS. Currently i...
SolidFire Management Node (aka mNode) is a VM that runs Hybrid Cloud Services (various "management stuff".) Let's say we wanted to collect and analyze those ...
Kubernetes-native RBAC S3 Object Lock support "Officialized" (Kanister) blueprints for SQL Server and PostgreSQL Operator aka PGO OpenStack and vSph...
To answer the question quickly: logical backups make sense.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Previously I blogged about using Kasten with NetApp HCI and SolidFire, but I did not have time to examine another NetApp storage integration, namely that of ...
Rancher and other Kubernetes users want to protect their applications and data. NetApp HCI and its underlying SolidFire storage are used by NetApp Trident to...
Introduction
Normally SolidFire 11 and 12 use Management Network for volume backup. Some users prefer to have backup flow over Storage Network.
In the post that compares SolidFire Protection Domains with Availability Zones I had this illustration of network connectivity among SolidFire v12 cluster no...
Everyone should get the hard-to-find TR-4741 (NetApp Element Software Remote Replication), but to answer the simple question: "all of the above".
This comes up every so often:
Requirement Workflow Storage considerations Tools
A workaround for rethinning Create multiple NFS shares for ESXi Mount NFS shares in ESXi Create a VM with extra data disk on one of NFS shares Ens...
NetApp E-Series are fast-performing disk arrays frequently used by big data, analytics, video processing, NOSQL databases, and HPC applications. You can find...
This comes up every so often:
Introduction Existing material Related posts on this blog Observations TB per day Events per day Sizing challenges ...
In recent weeks I've done a fair amount of reading about log management solutions, and I have to say the quality of technical material related to Splunk and ...
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
Things are getting interesting Does EF-Series for Splunk on NetApp HCI make sense How does it work How does that compare with other HCI C...
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
This is a two-part post:
Oracle TimesTen XE Classic v22.1 has quite a few requirements and settings related to memory and storage. Some attributes directly and indirectly related to ...
Introduction
WTF is EON Mode What do I need to do to get Vertica EON Mode work with StorageGRID TLS certificate for HTTPS IP address for S3 API endp...
WTF is EConfig? What's new How I use EConfig DDP BeeGFS Troubles Conclusion Appendix A - BeeGFS sizer
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
NOTE: the Web site with this tool was improved and updated on 2024/04/19, so some details below may differ from current functionality
Dynamic Disk Pools vs. Disk Groups New DDP configuration What does that mean? Things to note SANtricity Web Services Proxy Web Proxy Container ...
RAID 6 vs DDP DDP expansion Disk media refresh with DDP pools Demo
Introduction How Other SolidFire-related tips Conclusion
solidfire-operator is a Proof-of-Concept operator for Kubernetes built using Operator Framework.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
Create a bucket, say quay, and a set of S3 keys for one of your S3 users to use with this bucket.
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
Introduction Configure SNMP trap destination in SANtricity OS Get E-Series MIB files and OID SANtricity SNMP walk SANtricity SNMP traps and trap e...
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
What, why and how HTTP Access from SQL Server Where does Docker come in Other S3 clients Backup use case Comp...
Introduction Backup to ONTAP S3 Network configuration Workflow Discussion Backup to ONTAP S3 DR to ONTAP S3 ...
ONTAP has had S3 service for a while now. While ONTAP S3 isn't meant to take over large and complex S3 workloads in which NetApp StorageGRID excels, it is mo...
NOTICE: all credentials and tokens on this page are samples, not leaked.
Background Firemox What it does, and doesn't (Stopping) scope creep Known issues and limitations Conclusion Demo and source c...
Who wants it and why? Perl for the win! Features Effort Appendix A: what works and how Appendix B: observations, problems, solutions Appendix ...
Introduction Storage options exposed in Virtual Manager Filesystem directory Physical disk device Preformatted block device ...
Introduction Challenges with vSphere 8 on NetApp HCI Alternatives NetApp HCI storage and data migration Summary Appendix A - VirtualBox Append...
Configure Proxmox 7.1 with SolidFire 12.3 SolidFire Demo VM on Proxmox
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
Introduction What's new with ZFS deduplication ZFS and E-Series Benefits of using ZFS with E-Series Deduplication Compression ...
A workaround for rethinning Create multiple NFS shares for ESXi Mount NFS shares in ESXi Create a VM with extra data disk on one of NFS shares Ens...
Following my previous post on TensorStore with BeeGFS I thought I should revisit another item from my lengthy to-do list: filesystem compression.
Objective How I tested Kafka tests and results Random ASCII records StorageGRID audit log Protecting Kafka on a single site...
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
This is a two-part post:
Why "Elasticsearches"?
WTF is Milvus Storage-related stuff Meta storage (etcd) Logs and queues Object store Storage efficiency High availabi...
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
Introduction How to configure What do Kafka notifications look like Similarities and differences compared to Elasticsearch search integration Use ...
NOTICE: all credentials and tokens on this page are samples, not leaked.
Problem statement Data replication Storage CSI drivers GPU compute nodes Performance monitoring Workflow
Introduction Compute layer and storage interconnect Small and large clusters HDDs, SSDs, RAID, DDP… How to automate E-Series volume provisioning t...
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
Backup repository choices for Kasten with E-Series Veeam Repository S3 bucket NFS share Which one to use? Cost and performance Se...
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
AWS mountpoint-s3 Deploy Use cases for E-Series and SolidFire S3 bucket as backup mountpoint Sub-bucket allocation ...
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
EPA v3.3.0 will be the next release of EPA and I'm aiming for two small improvements:
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
Backup repository choices for Kasten with E-Series Veeam Repository S3 bucket NFS share Which one to use? Cost and performance Se...
This is more appropriate for a tweet, but anyway…
Background Why this is cool Catches File/object duality considerations Conclusion Demo
Introduction The problem Solutions Notes on MinIO Notes on VersityGW Benchmarking and testing VersityGW on scale-out file systems vs ...
What Config How Using Conclusion Appendix - External performance test
What
What is a volume created by Volume Copy operation How does it work? Progress Reserve size Reserve location Priority Automating Volume Copy A...
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Problem statement Considerations First iteration Second iteration Conclusion
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
Introduction Create, discover, login Efficiency - zpools on SoliFire vs global SolidFire efficiencies Comparison with XFS and BTRFS ...
Introduction What is E-Series anyway Easy storage management Conclusion
Introduction What's new with ZFS deduplication ZFS and E-Series Benefits of using ZFS with E-Series Deduplication Compression ...
Introduction Digression Purpose Volume mode in PVC How does this help us with git clone problem Conclusion...
So, what filesystem block size does StorageGRID 11.8 use?
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
Introduction How to configure What do Kafka notifications look like Similarities and differences compared to Elasticsearch search integration Use ...
Introduction
Introduction Network Servers StorageGRID load balancer OS Storage Flash tier NL-SAS tier DDP vs RAID Gro...
Introduction What's new in 2025 Next steps
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
The Provider is now available from the official Terraform registry. This means we no longer need to download and build it manually. It is also easy to use it...
E-Series Performance Analyzer (EPA) v3.0.0 collects MEL (Major Event Log) events and send them to InfluxDB. I think SANtricity syslog events have similar inf...
Configure SANtricity to send array events to a remote syslog server
NOTICE: all credentials and tokens on this page are samples, not leaked.
SolidFire Management Node (aka mNode) is a VM that runs Hybrid Cloud Services (various "management stuff".) Let's say we wanted to collect and analyze those ...
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
Introduction How it works Rest Server E-Series Dealing with the risk of storage-side snapshot rotation Storage efficiency Thi...
NOTICE: all credentials and tokens on this page are samples, not leaked.
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
Introduction WTF is CSI Snapshot Data Movement (CSI SDM) Why is that a Good Thing Get ready to use CSI SDM with NetApp Astra Triden...
Objectives and tools Steps to set up backup with Kopia Steps on OS and SolidBackup Steps related to Kopia Ensuring SolidBackup an...
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
Introduction Software stack Getting E-Series events and metrics into PRTG Generic probes SNMP walk SNMP traps Custom sens...
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Introduction
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
Say you have a bucket called junk with "directory tree" (not really but…) several levels deep (junk/lev1/lev2) and want to do some ILM stuff on the stuff in ...
Introduction Reference architectures High-level design and best practices What's new in Cloudera Base Deployment topology Sizin...
HDFS Durability and External Protected Storage Does everyone need RF2 HDFS Erasure Coding Compression NFS gateway Snapsho...
WTH is "SSD Cache" Create SSD cache Configure HDD-based volumes to use SSD Cache Summary API for monitoring
While reading the excellent article Why We Migrated from Kubernetes to Nomad (2021) it occurred to me I spotted some of the same advantages while working on ...
I have a small Nomad cluster which can access a BeeGFS filesystem.
Introduction Setup Generic batch job with I/O to parallel filesystem File format conversion Summary Demo
Introduction Deploy Nomad with SolidFire Host Volumes Backup and restore Backup data from VM with SolidFire-based as Host Volumes Bac...
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
Backup repository choices for Kasten with E-Series Veeam Repository S3 bucket NFS share Which one to use? Cost and performance Se...
Introduction Show me Why? Thoughts Conclusion
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Snapshot attributes in SolidFire Hashtable example Snapshot with attributes Using snapshot attributes Conclusion
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
This is a two-part post:
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
NOTICE: all credentials and tokens on this page are samples, not leaked.
Requirement Workflow Storage considerations Tools
Introduction VMware's calculator (KB 96426) Example for NetApp HCI Conclusion
Introduction Storage options exposed in Virtual Manager Filesystem directory Physical disk device Preformatted block device ...
Introduction Challenges with vSphere 8 on NetApp HCI Alternatives NetApp HCI storage and data migration Summary Appendix A - VirtualBox Append...
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
The Provider is now available from the official Terraform registry. This means we no longer need to download and build it manually. It is also easy to use it...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Kubernetes-native RBAC S3 Object Lock support "Officialized" (Kanister) blueprints for SQL Server and PostgreSQL Operator aka PGO OpenStack and vSph...
Introduction What Kanister does Summary Demo
Rancher and other Kubernetes users want to protect their applications and data. NetApp HCI and its underlying SolidFire storage are used by NetApp Trident to...
NOTICE: all credentials and tokens on this page are samples, not leaked.
Create a bucket, say quay, and a set of S3 keys for one of your S3 users to use with this bucket.
Docker Registry
NOTICE: all credentials and tokens on this page are samples, not leaked.
Create a bucket, say quay, and a set of S3 keys for one of your S3 users to use with this bucket.
Docker Registry
You may have heard Grafana 11 is coming out soon.
NetApp HCI compute nodes are normally monitored from mNode, which is a VM that fetches events from both storage and compute nodes.
What's new in HCICollector v0.7 Improvements Setbacks What's next for HCICollector Unsolvable NetApp Trident Download HCI...
This series of posts has several parts:
Introduction Situation Procedure Kubernetes Conclusion Appendix A - upsize remote and resize in Longhorny
UPDATE Summary Introduction Comparison between PV Patching and Trident Volume Import approach Why only Scena...
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
Introduction Why Build data-app container and check its inventory Use it Conclusion
If you haven't enabled VVOLs on SolidFire (Element, eSDS), i.e. VASA service hasn't been enabled, there's no need to do anything.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
solidfire-operator is a Proof-of-Concept operator for Kubernetes built using Operator Framework.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
What, why and how HTTP Access from SQL Server Where does Docker come in Other S3 clients Backup use case Comp...
In a recent post I wrote about S3 Select in StorageGRID 11.6.
Problem statement Data replication Storage CSI drivers GPU compute nodes Performance monitoring Workflow
Introduction Compute layer and storage interconnect Small and large clusters HDDs, SSDs, RAID, DDP… How to automate E-Series volume provisioning t...
Most cloud users know about the various options to rent cloud compute resources.
Introduction How to configure What do Kafka notifications look like Similarities and differences compared to Elasticsearch search integration Use ...
Objective How I tested Kafka tests and results Random ASCII records StorageGRID audit log Protecting Kafka on a single site...
Multi-tiered storage in Kafka clusters How to leverage E-Series Performance vs. data protection overhead Sequential performance vs. lat...
WTF is EConfig? What's new How I use EConfig DDP BeeGFS Troubles Conclusion Appendix A - BeeGFS sizer
NOTE: the Web site with this tool was improved and updated on 2024/04/19, so some details below may differ from current functionality
Introduction Considerations Create configuration options Choice of query tool Show available options Query capacity range Manual selection of ...
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
Introduction SolidFire backup to S3 MinIO compression Results Conclusions
Following my previous post on TensorStore with BeeGFS I thought I should revisit another item from my lengthy to-do list: filesystem compression.
Problem statement Data replication Storage CSI drivers GPU compute nodes Performance monitoring Workflow
Introduction Compute layer and storage interconnect Small and large clusters HDDs, SSDs, RAID, DDP… How to automate E-Series volume provisioning t...
Introduction Cloudflare scenarios for Hybrid Cloud users Experiment Conclusion
Snapshot attributes in SolidFire Hashtable example Snapshot with attributes Using snapshot attributes Conclusion
PowerShell (still) rocks PowerShell-based services Some ideas and use cases De-skill Kubernetes operations Provide RBAC to PowerShell...
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
SolidFire vs. Ransomware
SolidFire vs. Ransomware
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
Backup repository choices for Kasten with E-Series Veeam Repository S3 bucket NFS share Which one to use? Cost and performance Se...
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
What Config How Using Conclusion Appendix - External performance test
What
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
Introduction
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
Update (2024/06): I haven't tested this yet, but it seems after Velero AWS Plugin v1.9, ONTAP S3 users can no longer use Velero. One workaround for this is t...
Introduction SMB and NFS data migration Shell scripts and utilities XCP Elaborate schemes Enterprise software Example...
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
This is the first of possibly several posts on Microsoft Windows Server 2025 and NetApp SolidFire.
What, why and how HTTP Access from SQL Server Where does Docker come in Other S3 clients Backup use case Comp...
Objectives and tools Steps to set up backup with Kopia Steps on OS and SolidBackup Steps related to Kopia Ensuring SolidBackup an...
What is Simple Backups? Use Simple Backups for File-type backup with SolidFire clones mounted to a "backup VM" Backup sizes compared to Solid...
Why Automation Generate data and backup volumes Restore S3 backups to new SolidFire volumes Restore-related notes Cost estimati...
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
This is a two-part post:
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
Introduction What is the OPEA project The stack Docker vs. Kubernetes Where's the storage? E-Series storage and solution stack ...
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
Intro About QoS histograms on NetApp SolidFire Request Response What are these things? Bucket naming Should you use QoS histogram information?...
Say we have a Volume ID 321 with a storage QoS Policy ID 5, and need to run a temporary job that would benefit from a different Storage QoS Policy (higher or...
Rocky Linux 8 and 9 have been added to the NetApp E-Series interoperability matrix starting with SANtricity 11.70.
If you search for "iSCSI vs FC performance" it's not easy to find a recent like-for-like comparison from enterprise vendors. I've been puzzled by this and I ...
ONTAP has had S3 service for a while now. While ONTAP S3 isn't meant to take over large and complex S3 workloads in which NetApp StorageGRID excels, it is mo...
Summary Why test EF280 performance from a VM VMFS vs. Raw Devices Manageability and iSCSI Cost of an All Flash backup tier ...
Introduction Longer answer Other notes Disk snapshots and security E-Series vs. internal RAID Hardened repository volumes on E-Series w...
Summary Why test EF280 performance from a VM VMFS vs. Raw Devices Manageability and iSCSI Cost of an All Flash backup tier ...
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Things are getting interesting Does EF-Series for Splunk on NetApp HCI make sense How does it work How does that compare with other HCI C...
Introduction Existing material Related posts on this blog Observations TB per day Events per day Sizing challenges ...
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
PowerShell (still) rocks PowerShell-based services Some ideas and use cases De-skill Kubernetes operations Provide RBAC to PowerShell...
NetApp Hybrid Cloud Control (HCC) lets you access volume details to a slightly greater detail than the SolidFire Web UI. One additional detail that we are in...
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
In the previous post I explained how SolidFire's built-in backup/restore to/from S3 works and how we can automate it. This post is about doing less automatio...
Introduction Storage options exposed in Virtual Manager Filesystem directory Physical disk device Preformatted block device ...
In the previous post I explained how SolidFire's built-in backup/restore to/from S3 works and how we can automate it. This post is about doing less automatio...
Introduction Fixing RBAC with a TLS-terminating reverse proxy Lua in reverse proxy path JSON-RPC Lua and JSON-RPC Complicate things...
Everyone should get the hard-to-find TR-4741 (NetApp Element Software Remote Replication), but to answer the simple question: "all of the above".
Create two buckets, source and destination, a PUT a test object with some junk tags to source/.
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
Create a bucket, say quay, and a set of S3 keys for one of your S3 users to use with this bucket.
HDFS Durability and External Protected Storage Does everyone need RF2 HDFS Erasure Coding Compression NFS gateway Snapsho...
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
Introduction Fixing RBAC with a TLS-terminating reverse proxy Lua in reverse proxy path JSON-RPC Lua and JSON-RPC Complicate things...
NOTICE: all credentials and tokens on this page are samples, not leaked.
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
Kubernetes-native RBAC S3 Object Lock support "Officialized" (Kanister) blueprints for SQL Server and PostgreSQL Operator aka PGO OpenStack and vSph...
Introduction Challenges with vSphere 8 on NetApp HCI Alternatives NetApp HCI storage and data migration Summary Appendix A - VirtualBox Append...
Introduction XCP-NG with SolidFire XOA Conclusion
Introduction Why Build data-app container and check its inventory Use it Conclusion
Apptainer is based on the Singularity project.
Rocky Linux 8 and 9 have been added to the NetApp E-Series interoperability matrix starting with SANtricity 11.70.
The official Trident documentation is okay, but it mentions no Rocky Linux.
Rocky Linux 8 and 9 have been added to the NetApp E-Series interoperability matrix starting with SANtricity 11.70.
The official Trident documentation is okay, but it mentions no Rocky Linux.
Introduction What is E-Series anyway Easy storage management Conclusion
Introduction Why LXD on BeeGFS (with or without NetApp E-Series) Get started Optimal BeeGFS settings HA BeeGFS client in LXD VMs on LXD server a...
Busybodies@work I want 123456 Ending Appendix A: recommended low-quality password settings for pwquality.conf
Long story short, password rotation scripts should directly use the SANtricity (or Web Services Proxy, if you can't get directly to SANtricity) API and not t...
Why "Elasticsearches"?
Configure SANtricity to send array events to a remote syslog server
Introduction How to configure What do Kafka notifications look like Similarities and differences compared to Elasticsearch search integration Use ...
E-Series Performance Analyzer (EPA) v3.0.0 collects MEL (Major Event Log) events and send them to InfluxDB. I think SANtricity syslog events have similar inf...
WTH is "SSD Cache" Create SSD cache Configure HDD-based volumes to use SSD Cache Summary API for monitoring
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
Why overprovisioning exists Who needs this BeeGFS example Who doesn't need this Impact on capacity sizing Impact on deployment ...
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
Why and when automate Cloud Sync?
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
Why and when automate Cloud Sync?
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
Why and when automate Cloud Sync?
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Introduction Cold multi-volume backup without snapshots Group Snapshot-assisted multi-volume backup Backup multi-volume snapshot to S3 with...
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
Introduction General notes on NTFS rehinning and SolidFire QoS-related tips Prepare Windows host volume SDelete SDelete with Windows gu...
A workaround for rethinning Create multiple NFS shares for ESXi Mount NFS shares in ESXi Create a VM with extra data disk on one of NFS shares Ens...
Introduction General notes on NTFS rehinning and SolidFire QoS-related tips Prepare Windows host volume SDelete SDelete with Windows gu...
A workaround for rethinning Create multiple NFS shares for ESXi Mount NFS shares in ESXi Create a VM with extra data disk on one of NFS shares Ens...
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
Why "Elasticsearches"?
Introduction
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
Objectives and tools Steps to set up backup with Kopia Steps on OS and SolidBackup Steps related to Kopia Ensuring SolidBackup an...
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
Introduction The problem Solutions Notes on MinIO Notes on VersityGW Benchmarking and testing VersityGW on scale-out file systems vs ...
What Config How Using Conclusion Appendix - External performance test
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Problem statement Considerations First iteration Second iteration Conclusion
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Problem statement Considerations First iteration Second iteration Conclusion
NOTICE: all credentials and tokens on this page are samples, not leaked.
Introduction Environment Tests Results Other performance views Conclusion
Busybodies@work I want 123456 Ending Appendix A: recommended low-quality password settings for pwquality.conf
Introduction Create, discover, login Efficiency - zpools on SoliFire vs global SolidFire efficiencies Comparison with XFS and BTRFS ...
What is Verda Example with Redis Conclusion
Introduction Backup detail enhancements in Velero v1.13 Mapping Velero jobs to SolidFire volume and snapshot objects How many Veler...
If you want to develop or automate E-Series but aren't always connected, you may want to work offline with Swagger API files.
SolidFire doesn't have an OpenAPI interface. See here.
If you want to develop or automate E-Series but aren't always connected, you may want to work offline with Swagger API files.
SolidFire doesn't have an OpenAPI interface. See here.
Introduction SolidFire volume replication Failed and not-so-successful approaches Write workload at destination Node throughput ...
Introduction SMB and NFS data migration Shell scripts and utilities XCP Elaborate schemes Enterprise software Example...
Introduction MCP Use cases? Get, set, and security Conclusion Additional reading
Background Why this is cool Catches File/object duality considerations Conclusion Demo
Introduction What's new in BeeGFS file-system events in BeeGFS v8 Dude, where's my gRPC server? Can BeeGFS watch server, erhm, client, ...
Background Why this is cool Catches File/object duality considerations Conclusion Demo
Introduction What's new in BeeGFS file-system events in BeeGFS v8 Dude, where's my gRPC server? Can BeeGFS watch server, erhm, client, ...
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
This is a two-part post:
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
This is a two-part post:
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
This is a two-part post:
Introduction Walk-through And now… Conclusion Appendix A: demo Animated GIF (no playback control) Video demo with voice-over ...
Introduction What it is What it does IIS Setup Why this matters What about it? Conclusion
I've done my fair share of googling and was surprised to see there are so many complex ways to use Github pages.
NetApp HCI, SolidFire, eSDS Web UI
Introduction Update 1 (2023/08/30) Update 2 (2025/05/03) Update 3 (2025/06/07) FAQs
Introduction Update 1 (2023/08/30) Update 2 (2025/05/03) Update 3 (2025/06/07) FAQs
If you search for "iSCSI vs FC performance" it's not easy to find a recent like-for-like comparison from enterprise vendors. I've been puzzled by this and I ...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Rancher and other Kubernetes users want to protect their applications and data. NetApp HCI and its underlying SolidFire storage are used by NetApp Trident to...
This comes up every so often:
Summary Why test EF280 performance from a VM VMFS vs. Raw Devices Manageability and iSCSI Cost of an All Flash backup tier ...
"There's no documentation" is different from "there are no copy-paste examples".
In recent weeks I've done a fair amount of reading about log management solutions, and I have to say the quality of technical material related to Splunk and ...
NetApp Cloud Backup Service backs up your ONTAP data to your Object Storage bucket located in the cloud (Amazon, Azure, Google Cloud).
NetApp Cloud Backup Service backs up your ONTAP data to your Object Storage bucket located in the cloud (Amazon, Azure, Google Cloud).
NetApp Cloud Backup Service backs up your ONTAP data to your Object Storage bucket located in the cloud (Amazon, Azure, Google Cloud).
NetApp Cloud Backup Service backs up your ONTAP data to your Object Storage bucket located in the cloud (Amazon, Azure, Google Cloud).
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NetApp Hybrid Cloud Control (HCC) lets you access volume details to a slightly greater detail than the SolidFire Web UI. One additional detail that we are in...
WTF is EON Mode What do I need to do to get Vertica EON Mode work with StorageGRID TLS certificate for HTTPS IP address for S3 API endp...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
UPDATE Summary Introduction Comparison between PV Patching and Trident Volume Import approach Why only Scena...
Introduction What does it do Storing and protecting your IoT data Object Stores for Photon IoT C2C (Cloud to Container) How to process IoT data up...
Introduction What does it do Storing and protecting your IoT data Object Stores for Photon IoT C2C (Cloud to Container) How to process IoT data up...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
SolidFire Double Helix
SolidFire Double Helix
SolidFire Double Helix
SolidFire Double Helix
SolidFire Double Helix
Everyone should get the hard-to-find TR-4741 (NetApp Element Software Remote Replication), but to answer the simple question: "all of the above".
Everyone should get the hard-to-find TR-4741 (NetApp Element Software Remote Replication), but to answer the simple question: "all of the above".
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Some two months ago I rewrote SGAC and released it as v0.1.
In the case you missed NetApp INSIGHT 2021 and want to catch up with latest SolidFire developments, I recommend to consider some of the following sessions.
Digital Ocean is a no-nonsense cloud provider that you've probably heard of.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
This is speculative and I haven't tried it, but it looks very interesting.
NOTICE: all credentials and tokens on this page are samples, not leaked.
If you haven't enabled VVOLs on SolidFire (Element, eSDS), i.e. VASA service hasn't been enabled, there's no need to do anything.
It's very easy and works as you expected:
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
In a recent post I wrote about S3 Select in StorageGRID 11.6.
In a recent post I wrote about S3 Select in StorageGRID 11.6.
In a recent post I wrote about S3 Select in StorageGRID 11.6.
One annoyance with Active IQ connectivity from Hybrid Cloud Control for SolidFire/NetApp HCI/eSDS is that it's not easy to tell what's going on with it when ...
One annoyance with Active IQ connectivity from Hybrid Cloud Control for SolidFire/NetApp HCI/eSDS is that it's not easy to tell what's going on with it when ...
NOTICE: all credentials and tokens on this page are samples, not leaked.
ONTAP has had S3 service for a while now. While ONTAP S3 isn't meant to take over large and complex S3 workloads in which NetApp StorageGRID excels, it is mo...
Introduction
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Introduction
Introduction
Introduction How it works Rest Server E-Series Dealing with the risk of storage-side snapshot rotation Storage efficiency Thi...
Configure Proxmox 7.1 with SolidFire 12.3 SolidFire Demo VM on Proxmox
One of more obvious characteristics of Persistent Volumes is they persist, i.e. survive pod(s) that use them until the claim for the PV itself is deleted, as...
Why access Trident API Controller routes Trident resources Expose the Trident REST API Examples What about it Appendix: List of Trident Resour...
How would we use SolidFire Backup to S3 with Object Lock-enabled buckets Practical observations How many S3 objects or accounts do we need ...
NetApp E-Series are fast-performing disk arrays frequently used by big data, analytics, video processing, NOSQL databases, and HPC applications. You can find...
Most cloud users know about the various options to rent cloud compute resources.
I'm supposed to be resting this week and that hasn't been working out… Still, I'll try to keep this one shorter than the previous two posts from this week.
I'm supposed to be resting this week and that hasn't been working out… Still, I'll try to keep this one shorter than the previous two posts from this week.
WTF is Milvus Storage-related stuff Meta storage (etcd) Logs and queues Object store Storage efficiency High availabi...
WTF is Milvus Storage-related stuff Meta storage (etcd) Logs and queues Object store Storage efficiency High availabi...
WTF is Milvus Storage-related stuff Meta storage (etcd) Logs and queues Object store Storage efficiency High availabi...
Introduction
Introduction XCP-NG with SolidFire XOA Conclusion
Introduction XCP-NG with SolidFire XOA Conclusion
There's a PowerShell script sfvid2nid.ps1 in my Awesome SolidFire repository on Github. It produces a table that shows the mapping of volume IDs to node IDs.
Nextflow configuration and environment variables allow us to make use of BeeGFS with E-Series for most demanding IO tasks.
Oracle TimesTen XE Classic v22.1 has quite a few requirements and settings related to memory and storage. Some attributes directly and indirectly related to ...
Oracle TimesTen XE Classic v22.1 has quite a few requirements and settings related to memory and storage. Some attributes directly and indirectly related to ...
Normally SolidFire 11 and 12 use Management Network for volume backup. Some users prefer to have backup flow over Storage Network.
Introduction Why Build data-app container and check its inventory Use it Conclusion
Introduction Why LXD on BeeGFS (with or without NetApp E-Series) Get started Optimal BeeGFS settings HA BeeGFS client in LXD VMs on LXD server a...
Weka has a nice documentation site based on GitBook. I love good documentation!
Weka has a nice documentation site based on GitBook. I love good documentation!
This week NetApp released product communique CPC-00467 (NetApp support portal login required) on end of availability of SolidFire.
This week NetApp released product communique CPC-00467 (NetApp support portal login required) on end of availability of SolidFire.
TensorStore is a new C++ and Python library that provides a uniform API for reading and writing n-dimensional data.
Introduction Cloudflare scenarios for Hybrid Cloud users Experiment Conclusion
Introduction Cloudflare scenarios for Hybrid Cloud users Experiment Conclusion
Introduction Cloudflare scenarios for Hybrid Cloud users Experiment Conclusion
Maybe you've used an app (or an ONTAP feature) that makes use of the FPolicy API. FPolicy is proven in large and busy NAS environments, and has rich features...
Maybe you've used an app (or an ONTAP feature) that makes use of the FPolicy API. FPolicy is proven in large and busy NAS environments, and has rich features...
BeeGFS can work with different storage targets, so just like with Spectrum Scale it is possible to create a filesystem that spans across different disk media...
BeeGFS can work with different storage targets, so just like with Spectrum Scale it is possible to create a filesystem that spans across different disk media...
Introduction API Check TLS Traditional login JWTs Use SANtricity Bearer Token Demo References Conclusion
Introduction API Check TLS Traditional login JWTs Use SANtricity Bearer Token Demo References Conclusion
Introduction API Check TLS Traditional login JWTs Use SANtricity Bearer Token Demo References Conclusion
Introduction API Check TLS Traditional login JWTs Use SANtricity Bearer Token Demo References Conclusion
Long story short, password rotation scripts should directly use the SANtricity (or Web Services Proxy, if you can't get directly to SANtricity) API and not t...
CSI choices for E-Series in a Kubernetes environment What's out there in terms of DAS CSI for Kubernetes Unique DAS approaches How ...
CSI choices for E-Series in a Kubernetes environment What's out there in terms of DAS CSI for Kubernetes Unique DAS approaches How ...
CSI choices for E-Series in a Kubernetes environment What's out there in terms of DAS CSI for Kubernetes Unique DAS approaches How ...
Configure SANtricity to send array events to a remote syslog server
E-Series Performance Analyzer (EPA) v3.0.0 collects MEL (Major Event Log) events and send them to InfluxDB. I think SANtricity syslog events have similar inf...
This week NetApp released BeeGFS CSI driver v1.4.0 which adds support for newer Kubernetes and BeeGFS.
Problem statement Data replication Storage CSI drivers GPU compute nodes Performance monitoring Workflow
PowerShell (still) rocks PowerShell-based services Some ideas and use cases De-skill Kubernetes operations Provide RBAC to PowerShell...
PowerShell (still) rocks PowerShell-based services Some ideas and use cases De-skill Kubernetes operations Provide RBAC to PowerShell...
Why overprovisioning exists Who needs this BeeGFS example Who doesn't need this Impact on capacity sizing Impact on deployment ...
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
Why and when automate Cloud Sync?
Why and when automate Cloud Sync?
Why and when automate Cloud Sync?
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
EPA v3.3.0 will be the next release of EPA and I'm aiming for two small improvements:
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
Introduction Cold multi-volume backup without snapshots Group Snapshot-assisted multi-volume backup Backup multi-volume snapshot to S3 with...
AWS mountpoint-s3 Deploy Use cases for E-Series and SolidFire S3 bucket as backup mountpoint Sub-bucket allocation ...
AWS mountpoint-s3 Deploy Use cases for E-Series and SolidFire S3 bucket as backup mountpoint Sub-bucket allocation ...
A workaround for rethinning Create multiple NFS shares for ESXi Mount NFS shares in ESXi Create a VM with extra data disk on one of NFS shares Ens...
A workaround for rethinning Create multiple NFS shares for ESXi Mount NFS shares in ESXi Create a VM with extra data disk on one of NFS shares Ens...
Table of Contents
Table of Contents
Now that Azure Linux is out, maybe some SolidFire users wonder if Azure Linux iSCSI can connect to SolidFire targets?
Now that Azure Linux is out, maybe some SolidFire users wonder if Azure Linux iSCSI can connect to SolidFire targets?
So… I don't use Generative AI.
So… I don't use Generative AI.
So… I don't use Generative AI.
So… I don't use Generative AI.
Introduction
Introduction
Introduction Backup to ONTAP S3 Network configuration Workflow Discussion Backup to ONTAP S3 DR to ONTAP S3 ...
What, why and how HTTP Access from SQL Server Where does Docker come in Other S3 clients Backup use case Comp...
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
Introduction Digression Purpose Volume mode in PVC How does this help us with git clone problem Conclusion...
Introduction Digression Purpose Volume mode in PVC How does this help us with git clone problem Conclusion...
Introduction Digression Purpose Volume mode in PVC How does this help us with git clone problem Conclusion...
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
Why Automation Generate data and backup volumes Restore S3 backups to new SolidFire volumes Restore-related notes Cost estimati...
Why Automation Generate data and backup volumes Restore S3 backups to new SolidFire volumes Restore-related notes Cost estimati...
Why Automation Generate data and backup volumes Restore S3 backups to new SolidFire volumes Restore-related notes Cost estimati...
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
What is Simple Backups? Use Simple Backups for File-type backup with SolidFire clones mounted to a "backup VM" Backup sizes compared to Solid...
What is Simple Backups? Use Simple Backups for File-type backup with SolidFire clones mounted to a "backup VM" Backup sizes compared to Solid...
Introduction Configure SNMP trap destination in SANtricity OS Get E-Series MIB files and OID SANtricity SNMP walk SANtricity SNMP traps and trap e...
Introduction Configure SNMP trap destination in SANtricity OS Get E-Series MIB files and OID SANtricity SNMP walk SANtricity SNMP traps and trap e...
Introduction Configure SNMP trap destination in SANtricity OS Get E-Series MIB files and OID SANtricity SNMP walk SANtricity SNMP traps and trap e...
Problem statement E-Series side Ubuntu side Hardware and software stack Setup workflow Tips and tricks SANtricity Host settings ...
Problem statement E-Series side Ubuntu side Hardware and software stack Setup workflow Tips and tricks SANtricity Host settings ...
Introduction Software stack Getting E-Series events and metrics into PRTG Generic probes SNMP walk SNMP traps Custom sens...
Introduction Software stack Getting E-Series events and metrics into PRTG Generic probes SNMP walk SNMP traps Custom sens...
Introduction Software stack Getting E-Series events and metrics into PRTG Generic probes SNMP walk SNMP traps Custom sens...
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
Problem statement Considerations First iteration Second iteration Conclusion
Introduction Environment Tests Results Other performance views Conclusion
Introduction Environment Tests Results Other performance views Conclusion
Introduction Environment Tests Results Other performance views Conclusion
Introduction Environment Tests Results Other performance views Conclusion
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
NOTICE: all credentials and tokens on this page are samples, not leaked.
I'm curious if I should buy a more expensive GPU so I use nvidia-smi to see how busy the current one is.
Introduction Fixing RBAC with a TLS-terminating reverse proxy Lua in reverse proxy path JSON-RPC Lua and JSON-RPC Complicate things...
Introduction Fixing RBAC with a TLS-terminating reverse proxy Lua in reverse proxy path JSON-RPC Lua and JSON-RPC Complicate things...
Introduction General notes on NTFS rehinning and SolidFire QoS-related tips Prepare Windows host volume SDelete SDelete with Windows gu...
Introduction General notes on NTFS rehinning and SolidFire QoS-related tips Prepare Windows host volume SDelete SDelete with Windows gu...
Introduction General notes on NTFS rehinning and SolidFire QoS-related tips Prepare Windows host volume SDelete SDelete with Windows gu...
Introduction General notes on NTFS rehinning and SolidFire QoS-related tips Prepare Windows host volume SDelete SDelete with Windows gu...
Introduction Torch checkpoints Filesystem format, path and files Example Storage considerations File system considerations S3 vs cluster file ...
Introduction Torch checkpoints Filesystem format, path and files Example Storage considerations File system considerations S3 vs cluster file ...
Introduction Torch checkpoints Filesystem format, path and files Example Storage considerations File system considerations S3 vs cluster file ...
Introduction Torch checkpoints Filesystem format, path and files Example Storage considerations File system considerations S3 vs cluster file ...
Introduction Torch checkpoints Filesystem format, path and files Example Storage considerations File system considerations S3 vs cluster file ...
Introduction Torch checkpoints Filesystem format, path and files Example Storage considerations File system considerations S3 vs cluster file ...
Introduction Torch checkpoints Filesystem format, path and files Example Storage considerations File system considerations S3 vs cluster file ...
Introduction KEDA concepts and components Scalers KEDA and persistent storage SolidFire E-Series Storage-related events ...
Introduction KEDA concepts and components Scalers KEDA and persistent storage SolidFire E-Series Storage-related events ...
Introduction Longer answer Other notes Disk snapshots and security E-Series vs. internal RAID Hardened repository volumes on E-Series w...
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
Introduction Network Servers StorageGRID load balancer OS Storage Flash tier NL-SAS tier DDP vs RAID Gro...
Introduction VMware's calculator (KB 96426) Example for NetApp HCI Conclusion
Introduction VMware's calculator (KB 96426) Example for NetApp HCI Conclusion
Introduction How to configure What do Kafka notifications look like Similarities and differences compared to Elasticsearch search integration Use ...
Introduction How to configure What do Kafka notifications look like Similarities and differences compared to Elasticsearch search integration Use ...
Introduction What's new with ZFS deduplication ZFS and E-Series Benefits of using ZFS with E-Series Deduplication Compression ...
Introduction What's new with ZFS deduplication ZFS and E-Series Benefits of using ZFS with E-Series Deduplication Compression ...
Introduction What is E-Series anyway Easy storage management Conclusion
Introduction SANtricity API methods related to scrubbing, scanning, fixing data issues Media scan in Web UI Relevant API methods Implementation ...
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
So, what filesystem block size does StorageGRID 11.8 use?
So, what filesystem block size does StorageGRID 11.8 use?
What is Verda Example with Redis Conclusion
WTH is "SSD Cache" Create SSD cache Configure HDD-based volumes to use SSD Cache Summary API for monitoring
Introduction
Introduction
Introduction Reinventing the wheel Components Workflow Expected outcome Next steps Security Quotas and ACLs Monitoring ...
SolidFire doesn't have an OpenAPI interface. See here.
SolidFire doesn't have an OpenAPI interface. See here.
SolidFire doesn't have an OpenAPI interface. See here.
Busybodies@work I want 123456 Ending Appendix A: recommended low-quality password settings for pwquality.conf
Intro About QoS histograms on NetApp SolidFire Request Response What are these things? Bucket naming Should you use QoS histogram information?...
Introduction
Introduction Kubefire Simplified version of Longhorny focused on Kubernetes Automated replication service for SolidFire replication in ...
Introduction Kubefire Simplified version of Longhorny focused on Kubernetes Automated replication service for SolidFire replication in ...
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
Introduction How Other SolidFire-related tips Conclusion
Introduction How Other SolidFire-related tips Conclusion
While using ehm, a famous S3 server, I got annoyed by this stupid red dot.
While using ehm, a famous S3 server, I got annoyed by this stupid red dot.
What is a volume created by Volume Copy operation How does it work? Progress Reserve size Reserve location Priority Automating Volume Copy A...
What is a volume created by Volume Copy operation How does it work? Progress Reserve size Reserve location Priority Automating Volume Copy A...
Introduction Approach Steps One or more instances Prepare your box Clone Harvest repo or download pre-built container image ...
Introduction Reference architectures High-level design and best practices What's new in Cloudera Base Deployment topology Sizin...
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
Introduction MCP Use cases? Get, set, and security Conclusion Additional reading
Introduction What is the OPEA project The stack Docker vs. Kubernetes Where's the storage? E-Series storage and solution stack ...
I wrote about Windows Server 2025 here.
I wrote about Windows Server 2025 here.
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
Introduction SMB and NFS data migration Shell scripts and utilities XCP Elaborate schemes Enterprise software Example...
Introduction SMB and NFS data migration Shell scripts and utilities XCP Elaborate schemes Enterprise software Example...
"Adjustments" Latest and greatest: "breaking changes" Are you telling me there's a chance? Thoughts Risk and commercial ...
Background Firemox What it does, and doesn't (Stopping) scope creep Known issues and limitations Conclusion Demo and source c...
Introduction Show me Why? Thoughts Conclusion
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
Introduction What's new in 2025 Next steps
Introduction EPA 4 EPA Collector-specific Details related to storage requirements What's next